-- Logs begin at Thu 2022-07-14 10:50:40 UTC, end at Thu 2022-07-14 12:05:11 UTC. -- Jul 14 11:34:49.667328 dv-cinder-849803-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 11:34:49.675561 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 11:34:49 2022] *** Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: nodename: dv-cinder-849803-1-iscsi Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: machine: x86_64 Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: clock source: unix Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: pcre jit disabled Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: detected number of CPU cores: 4 Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: current working directory: / Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: detected binary path: /usr/bin/uwsgi-core Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: your processes number limit is 47680 Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: your memory page size is 4096 bytes Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: detected max file descriptor number: 2048 Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: lock engine: pthread robust mutexes Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: thunder lock: enabled Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 11:34:49.681296 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 11:34:49.724406 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: Python main interpreter initialized at 0x5594b618e9c0 Jul 14 11:34:49.724406 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: python threads support enabled Jul 14 11:34:49.724406 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: your server socket listen backlog is limited to 100 connections Jul 14 11:34:49.724406 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: your mercy for graceful operations on workers is 90 seconds Jul 14 11:34:49.724807 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 11:34:49.724807 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: *** Operational MODE: preforking *** Jul 14 11:34:49.725095 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: *** uWSGI is running in multiple interpreter mode *** Jul 14 11:34:49.725095 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: spawned uWSGI master process (pid: 110416) Jul 14 11:34:49.725325 dv-cinder-849803-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 11:34:49.726347 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: spawned uWSGI worker 1 (pid: 110417, cores: 1) Jul 14 11:34:49.726347 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: spawned uWSGI worker 2 (pid: 110418, cores: 1) Jul 14 11:34:49.726513 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 11:34:50.393093 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 11:34:50.407218 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 11:34:51.521236 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:34:51.521236 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: from cryptography.utils import int_from_bytes Jul 14 11:34:51.521885 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:34:51.521885 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: from cryptography.utils import int_from_bytes Jul 14 11:34:51.522857 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:34:51.522857 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: from cryptography.utils import int_from_bytes Jul 14 11:34:51.523316 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:34:51.523316 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: from cryptography.utils import int_from_bytes Jul 14 11:34:54.002095 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:34:54.003060 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:34:54.003060 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:34:54.003305 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:34:54.003485 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:34:54.003649 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:34:54.004037 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.004152 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:34:54.004250 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.004446 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:34:54.004551 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.004810 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.004907 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:34:54.005067 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:34:54.005209 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.005469 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.005563 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.005803 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.005953 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.006118 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.006257 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.006440 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.006563 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.006709 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.006836 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.007029 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.007127 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.007361 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849803-1-iscsi {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.007467 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.007682 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.007801 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.007995 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.008137 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.008264 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.008397 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.008569 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.008680 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.008898 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849803-1-iscsi {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.008987 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.009241 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.009331 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.009568 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.009661 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.009993 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.010279 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.010689 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.010689 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.010921 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.011065 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.011718 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.011881 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.012015 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.012296 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.012430 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.012612 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.012709 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.012926 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.013055 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.013284 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.013375 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.013601 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.013692 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.013934 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.014022 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.014248 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.014339 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.014581 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.014772 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849803-1-iscsi {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.014891 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.015022 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.015219 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.015359 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.015534 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.015630 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.015957 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849803-1-iscsi {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.016059 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.016279 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.016376 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.016593 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.016702 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.016908 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.017044 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.017256 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.017399 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.017567 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.017701 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.017896 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.018051 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.018220 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.018353 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.018542 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.018687 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.018863 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.019010 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.019179 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.019312 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.019504 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.019836 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.020267 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.020470 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.020603 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.020783 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.020916 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.021097 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.021294 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.021440 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.021576 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.021749 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.021904 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.022043 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.022188 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.022344 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.022486 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.022599 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.022769 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.022909 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.023044 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.023235 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.023372 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.023560 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.023693 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.023841 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.023976 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.024129 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.024263 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.024407 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.024548 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.024680 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.024977 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.025314 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.025628 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.025940 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.026251 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.026560 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.026680 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.026899 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.027027 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.027213 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.027362 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.027536 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.027691 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.027857 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.028021 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.028176 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.028351 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.028483 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.028668 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.028869 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.029132 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.029373 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.029501 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.029644 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.029788 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.029941 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.030294 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.030481 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.030654 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.030790 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.030988 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.031261 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.031470 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.031649 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.031841 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.031961 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.032311 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.032430 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.032642 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.032957 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.033075 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.033306 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.033617 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.033751 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.033944 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.034185 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.034273 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.034554 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.034807 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.034966 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.035202 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.035441 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.035574 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.035757 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.035933 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.036064 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.036209 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.036352 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.036499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.036672 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.036818 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.036985 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.037179 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.037318 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.037500 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.037614 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.037819 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.037968 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.038133 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.038445 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.038756 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.039071 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.039388 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.039720 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.039922 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.040035 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.040254 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.040480 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.040579 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.040659 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.040881 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.040969 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.041220 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.041355 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.041542 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.041637 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.041861 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.042003 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.042169 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.042300 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.042509 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.042645 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.042833 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.042971 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.043161 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.043304 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.043446 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.043597 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.043721 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.043800 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.044033 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.044117 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.044342 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.044432 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.044644 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.044787 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.044950 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.045082 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.045266 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.045409 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.045600 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.045737 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.045907 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.046037 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.046228 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.046533 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.046842 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.047165 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.047479 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.048045 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.048354 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.048662 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.048931 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.049085 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.049292 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.049426 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.049602 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.049736 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.049915 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.050052 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.050266 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.050417 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.050594 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.050724 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.050886 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.051045 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.051188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.051339 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.051473 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.051563 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.051758 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.051890 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.052081 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.052226 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.052392 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.052524 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.052707 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.052843 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.053025 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.053203 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.053337 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.053482 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.053646 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.053778 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.053954 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.054101 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.054281 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.054417 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.054611 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.054756 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.054929 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.055064 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.055245 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.055336 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.055557 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.055645 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.055883 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.055971 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:34:54.056200 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.056287 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.056523 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.056618 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.056845 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.056941 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.057196 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.057288 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.057521 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.057629 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.057843 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.058426 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.058681 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.058768 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.059155 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.059257 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.059486 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.059667 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.059821 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.059910 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.060138 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.060233 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.060459 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.060591 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.060778 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.060877 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.061146 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.061296 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.061453 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.061541 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.061792 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.061889 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.062122 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.062222 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.062438 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.062532 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.062754 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.062847 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.063072 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.063222 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.063400 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.063538 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.063738 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.063884 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.064057 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.064199 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.064379 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.064513 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.064695 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.064837 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.065013 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.065147 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.065419 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.065512 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.065791 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.065946 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.066097 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.066233 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.066438 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.066576 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.066761 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.066895 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.067080 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.067224 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.067398 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.067531 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.067725 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.067826 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.068091 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.068179 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.068523 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.068618 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.068993 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.069096 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.069487 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.069598 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.069882 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.069977 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.070205 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.070306 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.070523 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.070610 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.070837 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.070927 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.071165 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.071267 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.071488 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.071578 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.071800 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.071894 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.072124 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.072215 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.072440 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.072527 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.072756 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.072842 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.073097 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.073215 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.073653 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.074246 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.074587 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.074675 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.074985 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.075074 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.075310 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.075408 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.075623 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.075710 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.075953 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.076043 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.076272 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.076361 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.076584 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.076673 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.076913 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.077001 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.077250 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.077354 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.077566 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.077663 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.077881 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.077967 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.078195 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.078289 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.078509 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.078609 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.078827 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.079029 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.079197 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.079285 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.079634 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.079731 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.080147 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.080248 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.080508 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.080595 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.080829 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.080920 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.081174 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.081265 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.081498 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.081585 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.081811 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.081901 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.082135 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.082237 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.082456 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.082543 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.082769 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.082865 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.083085 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.083210 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.083395 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.083501 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.083734 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.083827 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.084196 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.084284 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.084662 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.084759 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.085030 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.085127 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.085373 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.085510 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.085687 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.085784 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.086000 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.086088 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.086311 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.086398 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.086641 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.086741 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.086957 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.087045 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.087269 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.087357 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.087578 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.087674 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.087886 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.087972 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.088192 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.088294 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.088510 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.088600 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.088817 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.088904 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.089148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.089269 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.089484 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.089583 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.089792 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.089881 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.090101 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.090188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.090429 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.090526 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.090745 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.090833 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.091053 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.091143 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.091365 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.091503 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.091674 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.091769 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.092022 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.092276 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.092409 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.092533 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.092647 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.092742 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.092964 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.093061 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.093322 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.093421 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.093636 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.093722 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.093955 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.094067 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.094259 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.094348 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.094571 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.094665 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.094889 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.094988 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.095207 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.095333 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.095523 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.095669 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.095847 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.095988 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.096160 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.096295 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.096478 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.096624 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.096782 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.096923 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.097098 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.097275 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.097422 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.097556 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.097744 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.097881 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.098048 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.098191 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.098368 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.098504 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.098688 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.098835 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.099002 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.099145 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.099329 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.099467 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.099634 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.099784 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.099947 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.100079 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.100260 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.100396 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.100574 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.100719 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.100885 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.100975 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.101220 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.101372 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.101537 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.101675 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.101854 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.101990 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.102165 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.102264 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.102480 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.102611 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.102788 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.102944 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.103086 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.103233 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.103400 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.103510 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.103712 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.103803 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.104016 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.104114 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.104334 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.104427 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.104647 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.104748 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.104989 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.105079 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.105333 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.105422 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.105650 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.105755 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.105959 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.106055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.106265 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.106352 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.106571 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.106658 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.106882 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.106976 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.107191 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.107278 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.107499 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.107586 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.107834 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.107941 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.108131 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.108227 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.108436 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.108530 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.108742 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.108835 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.109047 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.109134 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.109389 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.109490 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.109695 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.109785 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.110000 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.110086 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.110312 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.110432 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.110625 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.110713 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.110948 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.111063 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.111290 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.111395 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.111556 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.111652 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.111875 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.111961 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.112183 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.112272 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.112492 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.112581 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.112801 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.112894 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.113111 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.113233 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.113450 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.113610 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.113746 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.113891 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.114057 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.114195 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.114371 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.114508 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.114686 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.114832 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.114999 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.115136 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.115310 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.115445 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.115630 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.115853 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.115997 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.116129 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.116264 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.116403 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.116539 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.116682 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.116827 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.116960 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.117128 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.117316 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.117470 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.117680 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.117814 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.118056 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.118201 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.118379 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.118517 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.118697 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.118833 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.119006 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.119146 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.119330 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.119480 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.119644 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.119781 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.119956 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.120093 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.120267 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.120923 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.121113 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.121364 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.121514 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.121658 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.121793 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.121927 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.122072 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.122315 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.122449 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.122653 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.122816 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.122956 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.123104 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.123264 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.123402 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.123572 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.123706 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.123884 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.124030 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.124192 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.124328 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.124497 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.124629 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.124804 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.124946 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.125111 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.125283 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.125472 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.125615 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.125780 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.125998 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.126153 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.126288 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.126419 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.126550 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.126680 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.126812 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.126983 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.127117 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.127290 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.127425 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.127597 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.127750 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.127887 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.127986 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.128192 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.128326 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.128498 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.128644 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.128810 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.128948 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.129134 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.129300 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.129452 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.129596 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.129737 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.129870 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.130046 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.130184 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.130372 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.130506 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.130684 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.130816 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.130992 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.131133 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.131290 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.131487 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.131633 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.131766 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.131906 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.132041 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.132209 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.132364 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.132525 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.132660 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.132839 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.132983 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.133167 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.133317 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.133504 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.133643 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.133809 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.133909 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.134118 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.134206 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.134425 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.134520 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.134732 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.134829 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.135038 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.135126 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.135341 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.135428 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.135648 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.135745 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.135950 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.136152 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.136801 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.136890 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.137110 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.137241 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.137450 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.137539 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.137754 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.137840 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.138061 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.138158 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.138367 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.138453 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.138668 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.138756 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.138974 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.139068 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.139287 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.139387 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.139593 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.139681 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.139896 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.139990 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.140205 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.140292 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.140512 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.140607 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.140815 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.140904 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.141121 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.141290 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.141452 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.141693 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.141827 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.141970 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.142102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.142244 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.142374 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.142585 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.142677 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.142850 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.142980 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.143110 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.143251 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.143393 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.143525 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.143667 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.143861 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.143999 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.144131 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.144279 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.144412 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.144544 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.144721 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.144851 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.145023 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.145178 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.145351 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.145481 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.145655 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.145801 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.145947 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.146079 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.146259 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.146400 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.146575 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.146690 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.146881 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.146977 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.147185 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.147272 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.147528 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.147628 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.147792 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.147883 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.148096 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.148210 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.148404 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.148539 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.148705 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.148816 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.149013 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.149102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.149343 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.149447 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.149648 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.149735 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.149955 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.150062 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.150277 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.150413 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.150585 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.150717 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.150890 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.150985 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.151199 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.151340 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.151516 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.151693 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.151878 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.151991 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.152173 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.152293 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.152484 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.152595 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.152809 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.152945 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.153123 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.153264 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.153465 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.153588 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.153775 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.153888 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.154092 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.154245 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.154406 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.154541 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.154710 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.154842 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.155021 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.155155 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.155330 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.155466 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.155637 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.155782 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.155925 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.156068 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.156230 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.156382 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.156542 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.156684 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.156853 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.156997 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.157210 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.157348 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.157494 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.157649 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.157792 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.157934 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.158074 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.158206 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.158388 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.158531 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.158698 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.158832 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.159005 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.159139 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.159316 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.159463 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.159611 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.159742 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.159918 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.160009 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.160233 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.160369 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.160538 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.160679 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.160850 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.160986 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.161174 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.161312 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.161499 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.161663 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.161797 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.161937 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.162107 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.162197 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.162419 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.162506 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.162724 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.162811 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.163046 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.163134 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.163359 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.163454 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.163666 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.163763 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.163976 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.164064 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.164284 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.164396 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.164595 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.164715 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.164900 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.165031 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.165360 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.165452 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.165669 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.165769 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.165978 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.166066 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.166283 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.166372 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.166596 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.166693 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.166901 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.166988 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.167226 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.167329 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.167538 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.167634 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.167911 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.168414 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.168570 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.168737 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.168889 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.169052 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.169243 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.169378 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.169671 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.169762 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.169984 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.170125 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.170294 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.170381 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.170617 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.170713 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.170924 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.171012 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.171230 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.171326 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.171537 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.171702 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.171859 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.171950 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.172166 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.172261 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.172487 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.172584 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.173117 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.173234 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.173458 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.173557 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.173775 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.173871 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.174101 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.174187 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.174417 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.174546 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.174733 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.174830 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.175043 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.175143 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.175369 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.175458 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.175693 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.175781 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.176011 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.176111 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.176328 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.176418 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.176641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.176746 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.176965 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.177055 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.177318 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.177411 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.177634 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.177723 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.177952 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.178042 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.178259 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.178356 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.178582 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.178679 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.178892 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.178981 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.179200 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.179297 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.179508 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.179597 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.179832 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.179922 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.180139 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.180233 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.180452 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.180548 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.180771 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.180860 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.181082 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.181197 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.181419 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.181521 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.181727 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.181816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.182056 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.182210 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.182361 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.182521 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.182667 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.182768 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.183506 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.183644 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.183820 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.183923 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.184139 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.184228 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.184445 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.184533 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.184755 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.184844 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.185063 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.185170 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.185396 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.185504 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.185704 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.185801 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.186011 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.186099 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.186335 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.186423 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.186649 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.186737 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.186971 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.187066 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.187296 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.187384 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.187604 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.187694 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.187926 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.188026 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.188235 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.188337 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.188541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.188630 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.188849 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.188937 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.189326 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.189435 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.189519 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.189613 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.189823 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.189912 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.190129 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.190229 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.190445 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.190533 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.190755 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.190850 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.191064 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.191161 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.191377 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.191465 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.191689 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.191777 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.191998 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.192133 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.192305 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.192396 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.192611 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.192699 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.192932 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.193028 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.193264 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.193357 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.193579 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.193677 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.193889 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.193978 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.194195 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.194281 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.194497 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.194591 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.194802 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.194891 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.195105 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.195195 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.195411 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.195513 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.195717 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.195813 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.196041 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.196129 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.196346 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.196442 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.196667 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.196754 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.196979 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.197067 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.197315 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.197421 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.197625 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.197722 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.197931 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.198020 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.198248 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.198348 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.199098 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.199198 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.199441 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.199529 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.199773 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.199881 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.200078 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.200171 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.200392 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.200488 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.200706 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.200795 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.201023 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.201112 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.201366 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.201466 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.201687 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.201915 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.202010 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.202250 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.202406 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.202569 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.202712 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.202886 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.203024 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.203205 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.203337 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.203513 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.203650 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.203826 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.203966 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.204128 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.204217 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.204441 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.204569 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.204754 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.204979 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.205068 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.205344 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.205451 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.205665 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.205755 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.205985 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.206074 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.206302 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.206392 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.206621 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.206710 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.206936 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.207025 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.207253 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.207343 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.207567 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.207668 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.207881 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.207970 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.208195 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.208285 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.208528 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.208624 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.208844 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.208941 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.209176 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.209279 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.209504 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.209594 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.209823 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.209920 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.210138 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.210227 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.210456 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.210543 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.210772 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.210860 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.211083 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.211171 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.211401 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.211489 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.211718 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.211809 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.212036 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.212132 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.212364 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.212521 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.212693 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.212778 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.212976 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.213072 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.213317 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.213420 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.213637 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.213727 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.213953 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.214040 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.214344 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.214505 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.214663 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.214827 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.214982 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.215169 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.215302 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.215501 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.215631 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.215833 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.215968 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.216154 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.216293 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.216477 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.216609 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.216808 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.216925 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.217118 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.217270 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.217457 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.217772 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.217860 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.218086 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.218175 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.218394 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.218485 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.218721 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.218811 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.219037 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.219133 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.219346 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.219436 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.219667 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.219755 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.219978 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.220077 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.220293 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.220515 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.220648 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.220872 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.220960 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.221219 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.221321 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.221531 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.221621 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.221858 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.221947 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.222172 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.222261 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.222480 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.222617 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.222800 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.222887 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.223107 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.223196 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.223418 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.223645 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.223739 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.224000 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.224089 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.224321 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.224409 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.224625 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.224720 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.224939 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.225080 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.225275 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.225419 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.225583 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.225728 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.225896 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.226033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.226204 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.226342 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.226510 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.226651 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.226827 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.226963 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.227134 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.227270 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.227437 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.227582 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.227745 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.227882 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.228049 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.228193 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.228355 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.228500 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.228660 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.228797 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.228963 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.229098 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.229297 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.229441 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.229602 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.229757 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.229938 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.230088 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.230245 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.230389 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.230552 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.230651 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.230857 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.230996 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.231162 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.231306 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.231467 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.231600 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.231775 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.231909 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.232081 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.232215 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.232395 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.232547 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.232687 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.232819 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.233000 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.233143 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.233327 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.233464 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.233634 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.233774 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.233944 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.234089 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.234254 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.234394 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.234590 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.234730 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.234926 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.235123 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.235263 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.235460 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.235597 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.235783 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.235920 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.236118 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.236273 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.236439 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.236582 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.236750 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.236885 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.237061 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.237225 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.237400 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.237537 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.237726 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.237871 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.238038 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.238264 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.238406 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.238602 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.238737 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.238930 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.239070 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.239242 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.239373 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.239555 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.239689 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.239865 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.240006 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.240178 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.240322 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.240477 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.240611 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.240787 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.240920 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.241102 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.241295 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.241439 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.241579 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.241727 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.241854 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.242039 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.242262 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.242399 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.242533 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.242677 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.242816 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.242956 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.243097 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.243251 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.243385 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.243564 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.243698 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.243877 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.244022 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.244193 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.244344 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.244483 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.244619 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.244795 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.244933 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.245115 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.245282 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.245997 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.246112 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.246307 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.246399 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.246615 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.246718 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.246933 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.247032 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.247257 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.247356 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.247571 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.247690 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.247883 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.247989 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.248200 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.248311 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.248511 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.248615 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.248936 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.249040 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.249196 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.249300 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.249529 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.249617 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.249844 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.249936 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.250206 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.250333 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.250527 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.250635 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.250927 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.251034 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.251200 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.251306 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.251481 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.251621 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.251797 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.251887 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.252110 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.252208 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.252432 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.252547 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.252734 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.252881 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.253049 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.253213 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.253400 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.253498 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.253709 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.253830 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.254022 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.254188 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.254333 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.254520 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.254641 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.254857 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.254957 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.255165 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.255253 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.255477 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.255566 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.255793 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.255891 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.256118 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.256215 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.256421 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.256508 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.256726 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.256813 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.257031 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.257128 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.257366 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.257468 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.257675 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.257762 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.257980 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.258077 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.258284 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.258379 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.258590 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.258677 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.258899 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.258996 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.259202 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.259301 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.259511 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.259599 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.259824 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.259927 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.260132 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.260221 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.260439 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.260528 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.260745 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.260844 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.261605 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.261722 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.261923 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.262012 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.262236 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.262332 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.262545 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.262636 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.262853 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.262948 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.263157 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.263259 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.263492 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.263581 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.263815 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.263912 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.264132 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.264221 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.264447 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.264546 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.264759 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.264857 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.265071 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.265188 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.265412 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.265502 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.265740 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.265842 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.266067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.266156 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.266375 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.266463 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.266691 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.266789 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.267012 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.267100 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.267330 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.267460 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.267645 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.267736 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.267958 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.268046 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.268271 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.268358 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.268585 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.268683 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.268897 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.268985 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.269235 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.269364 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.269554 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.269648 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.269869 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.269959 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.270188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.270292 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.270502 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.270598 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.270818 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.270914 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.271141 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.271271 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.271455 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.271555 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.271786 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.271884 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.272101 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.272280 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.272404 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.272520 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.272719 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.272819 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.273033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.273146 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.273376 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.273474 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.273695 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.273786 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.274009 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.274098 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.274330 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.274443 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.274649 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.274764 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.274960 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.275051 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.275270 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.275383 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.275521 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:34:54.275616 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.275907 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.276235 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.276564 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.276937 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.277278 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.277630 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.277962 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.278282 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.278598 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.278906 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:34:54.279154 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:34:54.337928 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO dbcounter [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] Registered counter for database nova_api Jul 14 11:34:54.341186 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO dbcounter [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] Registered counter for database nova_api Jul 14 11:34:54.453653 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_db.sqlalchemy.engines [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:34:54.455368 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG oslo_db.sqlalchemy.engines [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:34:54.460254 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG dbcounter [-] [110418] Writer thread running {{(pid=110418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:34:54.461752 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG dbcounter [-] [110417] Writer thread running {{(pid=110417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:34:54.516938 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.context [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7a7b1c5-183a-455b-a224-c19c749ad259(cell1) {{(pid=110418) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 11:34:54.520978 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:54.522431 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.context [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7a7b1c5-183a-455b-a224-c19c749ad259(cell1) {{(pid=110417) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 11:34:54.522640 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:54.523448 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:54.525625 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:54.526374 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG oslo_concurrency.lockutils [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:54.527604 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO dbcounter [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] Registered counter for database nova_cell0 Jul 14 11:34:54.527981 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG oslo_concurrency.lockutils [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:54.528810 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG oslo_concurrency.lockutils [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:54.530961 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG oslo_concurrency.lockutils [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:54.531969 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO dbcounter [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] Registered counter for database nova_cell1 Jul 14 11:34:54.532933 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO dbcounter [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] Registered counter for database nova_cell0 Jul 14 11:34:54.536774 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO dbcounter [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] Registered counter for database nova_cell1 Jul 14 11:34:54.539442 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_db.sqlalchemy.engines [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:34:54.541511 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_db.sqlalchemy.engines [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:34:54.544787 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG oslo_db.sqlalchemy.engines [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:34:54.546955 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG oslo_db.sqlalchemy.engines [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:34:54.548527 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG dbcounter [-] [110418] Writer thread running {{(pid=110418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:34:54.549850 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG dbcounter [-] [110418] Writer thread running {{(pid=110418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:34:54.554204 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG dbcounter [-] [110417] Writer thread running {{(pid=110417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:34:54.555525 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG dbcounter [-] [110417] Writer thread running {{(pid=110417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:34:54.694848 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO dbcounter [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] Registered counter for database nova_cell0 Jul 14 11:34:54.704439 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_db.sqlalchemy.engines [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:34:54.707862 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO dbcounter [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] Registered counter for database nova_cell0 Jul 14 11:34:54.709422 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG dbcounter [-] [110418] Writer thread running {{(pid=110418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:34:54.716940 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG oslo_db.sqlalchemy.engines [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:34:54.721437 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG dbcounter [-] [110417] Writer thread running {{(pid=110417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:34:55.150105 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: WARNING keystonemiddleware.auth_token [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:34:55.157489 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: WARNING keystonemiddleware.auth_token [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:34:55.225774 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: WARNING keystonemiddleware.auth_token [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:34:55.233673 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: WARNING keystonemiddleware.auth_token [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:34:55.495560 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: WARNING keystonemiddleware.auth_token [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:34:55.501776 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: WARNING keystonemiddleware.auth_token [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:34:55.507222 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5594b618e9c0 pid: 110418 (default app) Jul 14 11:34:55.509539 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:34:55.510780 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001975 Jul 14 11:34:55.511530 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Thu Jul 14 11:34:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:34:55.605627 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: WARNING keystonemiddleware.auth_token [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:34:55.612039 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: WARNING keystonemiddleware.auth_token [None req-60f41f08-7d3a-4e64-a1a1-57d34d4545a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:34:55.617790 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5594b618e9c0 pid: 110417 (default app) Jul 14 11:36:15.408243 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:15.409606 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jul 14 11:36:15.410473 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 11:36:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:36:15.423189 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG dbcounter [-] [110417] Writing DB stats nova_api:SELECT=3 {{(pid=110417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:15.424344 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG dbcounter [-] [110417] Writing DB stats nova_cell0:SELECT=3 {{(pid=110417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:15.425110 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG dbcounter [-] [110417] Writing DB stats nova_cell1:SELECT=3 {{(pid=110417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:15.425911 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG dbcounter [-] [110417] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:16.305607 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-2a4a5aa9-4a39-4236-b06d-d1cb0bd9d20a admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:16.336009 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-2a4a5aa9-4a39-4236-b06d-d1cb0bd9d20a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918708 Jul 14 11:36:16.336932 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jul 14 11:36:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:18.619832 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:18.620663 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-0e75be74-c4c7-4a2c-972c-df9d8ffef55b None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 14 11:36:18.622031 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 11:36:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:36:19.106263 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-0150c52c-3ab4-4159-a96d-5c3d3671e342 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:19.125033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:36:19.125033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: warnings.warn(msg) Jul 14 11:36:19.225796 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-0150c52c-3ab4-4159-a96d-5c3d3671e342 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.598688 Jul 14 11:36:19.226873 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 11:36:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:36:19.445965 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-f2788b42-48f7-4391-9658-d552e801a851 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:19.448389 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:36:19.448389 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: warnings.warn(msg) Jul 14 11:36:19.469969 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG dbcounter [-] [110418] Writing DB stats nova_api:SELECT=3 {{(pid=110418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:19.471443 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG dbcounter [-] [110418] Writing DB stats nova_cell0:SELECT=3 {{(pid=110418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:19.472873 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG dbcounter [-] [110418] Writing DB stats nova_cell1:SELECT=3 {{(pid=110418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:19.474147 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG dbcounter [-] [110418] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:19.587428 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-f2788b42-48f7-4391-9658-d552e801a851 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.351977 Jul 14 11:36:19.588570 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jul 14 11:36:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:36:21.851886 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-0150c52c-3ab4-4159-a96d-5c3d3671e342 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:21.852917 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-0150c52c-3ab4-4159-a96d-5c3d3671e342 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002062 Jul 14 11:36:21.853704 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 11:36:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:36:22.559131 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-0f7846c3-4863-41c7-804e-d558cd6a6e57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1", "vcpus": 1, "name": "ds512M", "swap": 0}} {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:22.579017 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:36:22.579017 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: warnings.warn(msg) Jul 14 11:36:22.708837 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-0f7846c3-4863-41c7-804e-d558cd6a6e57 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.849042 Jul 14 11:36:22.709654 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 11:36:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:36:22.722017 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-0406300a-f006-4132-8fda-f16b8d147835 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:22.725797 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:36:22.725797 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: warnings.warn(msg) Jul 14 11:36:23.020333 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-0406300a-f006-4132-8fda-f16b8d147835 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.302226 Jul 14 11:36:23.025753 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jul 14 11:36:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:25.301185 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-0f7846c3-4863-41c7-804e-d558cd6a6e57 admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:25.302349 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-0f7846c3-4863-41c7-804e-d558cd6a6e57 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Jul 14 11:36:25.302759 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 11:36:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:36:25.707273 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-bd49ac1b-3b21-48fb-b3f9-930b74024567 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:25.810742 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-bd49ac1b-3b21-48fb-b3f9-930b74024567 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.502207 Jul 14 11:36:25.811291 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 11:36:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:36:25.823425 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-05f1e8d5-1f86-445f-b417-2a4751c849bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:26.026005 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-05f1e8d5-1f86-445f-b417-2a4751c849bc admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.206675 Jul 14 11:36:26.026598 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jul 14 11:36:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:28.329544 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-bd49ac1b-3b21-48fb-b3f9-930b74024567 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:28.330493 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-bd49ac1b-3b21-48fb-b3f9-930b74024567 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 14 11:36:28.330899 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 11:36:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:36:28.752971 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-1665c089-fdc1-49f9-bc2c-c863b5b7bd2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:28.839844 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-1665c089-fdc1-49f9-bc2c-c863b5b7bd2e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.503011 Jul 14 11:36:28.840841 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 11:36:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:36:28.852904 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-2e6292a1-2788-4419-a948-707877d95403 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:28.951332 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-2e6292a1-2788-4419-a948-707877d95403 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102125 Jul 14 11:36:28.952094 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jul 14 11:36:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:36:31.186941 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-1665c089-fdc1-49f9-bc2c-c863b5b7bd2e admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:31.188074 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-1665c089-fdc1-49f9-bc2c-c863b5b7bd2e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 14 11:36:31.188761 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 11:36:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:36:31.655501 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-b709eb38-8e2c-4013-8179-03b030afda97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "vcpus": 4, "ram": 4096, "disk": 20, "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:31.723848 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-b709eb38-8e2c-4013-8179-03b030afda97 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529044 Jul 14 11:36:31.724877 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 11:36:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:36:31.737879 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-4f25f2c5-de03-4b10-9abc-9b9aefedee5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:31.809784 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-4f25f2c5-de03-4b10-9abc-9b9aefedee5e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076225 Jul 14 11:36:31.810471 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jul 14 11:36:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:34.611860 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-b709eb38-8e2c-4013-8179-03b030afda97 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:34.613803 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-b709eb38-8e2c-4013-8179-03b030afda97 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002602 Jul 14 11:36:34.614651 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 11:36:34 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:36:35.077257 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-b81c7297-8d09-4f47-a0f3-75144ceba066 admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:35.100033 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-b81c7297-8d09-4f47-a0f3-75144ceba066 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.475078 Jul 14 11:36:35.101091 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jul 14 11:36:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:36:37.353890 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-b709eb38-8e2c-4013-8179-03b030afda97 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:37.354952 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-b709eb38-8e2c-4013-8179-03b030afda97 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jul 14 11:36:37.355365 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 11:36:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:36:37.816222 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-dbe439a1-dab2-48d5-9a0b-04237f8fc1ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:37.891990 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-dbe439a1-dab2-48d5-9a0b-04237f8fc1ab admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.530051 Jul 14 11:36:37.892560 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 11:36:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:36:37.905971 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-8592fda2-95ff-4f0a-8595-6e1a8cc2ec9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:37.998620 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-8592fda2-95ff-4f0a-8595-6e1a8cc2ec9c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097399 Jul 14 11:36:37.999236 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jul 14 11:36:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:40.260650 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-dbe439a1-dab2-48d5-9a0b-04237f8fc1ab admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:40.261636 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-dbe439a1-dab2-48d5-9a0b-04237f8fc1ab admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 14 11:36:40.262039 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 11:36:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:36:40.674198 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-dfb83fcd-2ed3-4326-94f4-2a63e6610a35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "id": "2", "ram": 2048, "vcpus": 1}} {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:40.776252 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-dfb83fcd-2ed3-4326-94f4-2a63e6610a35 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.500531 Jul 14 11:36:40.776252 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 11:36:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 11:36:40.782598 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-9788ae8a-d19b-493b-95ce-59d9122d5d29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:40.893319 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-9788ae8a-d19b-493b-95ce-59d9122d5d29 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114492 Jul 14 11:36:40.893906 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jul 14 11:36:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:43.150664 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-dfb83fcd-2ed3-4326-94f4-2a63e6610a35 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:43.153375 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-dfb83fcd-2ed3-4326-94f4-2a63e6610a35 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 14 11:36:43.153375 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 11:36:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:36:43.536079 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-f42c4571-c050-4feb-8506-7280753c4bcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "name": "m1.medium"}} {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:43.713529 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-f42c4571-c050-4feb-8506-7280753c4bcb admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.553573 Jul 14 11:36:43.715686 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 11:36:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:36:43.730679 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-cf967648-6a55-440b-adc7-7eda85aa07ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:44.036844 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-cf967648-6a55-440b-adc7-7eda85aa07ca admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.312447 Jul 14 11:36:44.053194 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jul 14 11:36:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:46.569608 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-f42c4571-c050-4feb-8506-7280753c4bcb admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:46.570543 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-f42c4571-c050-4feb-8506-7280753c4bcb admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 14 11:36:46.570953 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 11:36:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:36:47.033722 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-921fc94f-87cd-4d86-8a0f-11d90d6c2cc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80}} {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:47.041309 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG dbcounter [-] [110417] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:47.154641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-921fc94f-87cd-4d86-8a0f-11d90d6c2cc5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.577740 Jul 14 11:36:47.155103 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 11:36:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:36:47.168377 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-ab61bcc6-2f97-4fcd-afa8-5c9a360adc4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:47.270630 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-ab61bcc6-2f97-4fcd-afa8-5c9a360adc4d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107141 Jul 14 11:36:47.274554 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jul 14 11:36:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:49.655170 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-921fc94f-87cd-4d86-8a0f-11d90d6c2cc5 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:49.656218 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-921fc94f-87cd-4d86-8a0f-11d90d6c2cc5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Jul 14 11:36:49.656708 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 11:36:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:36:50.176920 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-ad5fffed-2e16-4b1f-80dc-0ddb656bb97a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "vcpus": 8, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:50.183205 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG dbcounter [-] [110418] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=110418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:50.329528 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-ad5fffed-2e16-4b1f-80dc-0ddb656bb97a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.666123 Jul 14 11:36:50.333194 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 11:36:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:36:50.342353 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-a1aa8217-b0c2-4f8b-a8ce-12c1c5c87bcf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:50.436676 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-a1aa8217-b0c2-4f8b-a8ce-12c1c5c87bcf admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097872 Jul 14 11:36:50.437330 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jul 14 11:36:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:37:09.980343 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-ad5fffed-2e16-4b1f-80dc-0ddb656bb97a admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:09.981413 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-ad5fffed-2e16-4b1f-80dc-0ddb656bb97a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 14 11:37:09.981943 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 11:37:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:37:10.371024 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-6bf9b52d-e9e6-4f81-b848-03b888aba53c admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:10.388572 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-6bf9b52d-e9e6-4f81-b848-03b888aba53c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400288 Jul 14 11:37:10.389115 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jul 14 11:37:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:37:11.452843 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-ad5fffed-2e16-4b1f-80dc-0ddb656bb97a admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:11.454070 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-ad5fffed-2e16-4b1f-80dc-0ddb656bb97a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Jul 14 11:37:11.454526 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 11:37:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:37:11.975181 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-6fa9dfed-14e8-4485-a3b7-b8d9f359e26b admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:11.980820 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.wsgi [None req-6fa9dfed-14e8-4485-a3b7-b8d9f359e26b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-6fa9dfed-14e8-4485-a3b7-b8d9f359e26b admin admin] Request method failure captured: Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Accept: application/json Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Accept-Encoding: gzip, deflate Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Connection: keep-alive Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Content-Length: 0 Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Host: 10.222.0.40 Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Openstack-Api-Version: compute 2.90 Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Openstack-System-Scope: None Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: User-Agent: python-novaclient Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Auth-Token: gAAAAABiz__nAfl7Cn1gD-0ElKYGHzQEucwCpwRDhsci6av2-Z4shV2IGE1bDWmsxiMOvkcTAFmKUXoykqE2TeF2jJKtzJqNmsPpy15XZ5F4D1rx-z5DDKQQilkkcocWUd9UzR7clE0M798kT52S0-AdttnB8o33w08rKYOh613ptK0zsGJ13xE Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Domain-Id: None Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Domain-Name: None Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Identity-Status: Confirmed Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Is-Admin-Project: True Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Project-Domain-Id: default Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Project-Domain-Name: Default Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Project-Id: da372d98ddc34559ac820df9de6d2798 Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Project-Name: admin Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Role: reader,admin,member Jul 14 11:37:11.984148 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Roles: reader,admin,member Jul 14 11:37:11.985799 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da372d98ddc34559ac820df9de6d2798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:37:11.985799 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Tenant: admin Jul 14 11:37:11.985799 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Tenant-Id: da372d98ddc34559ac820df9de6d2798 Jul 14 11:37:11.985799 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Tenant-Name: admin Jul 14 11:37:11.985799 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-User: admin Jul 14 11:37:11.985799 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-User-Domain-Id: default Jul 14 11:37:11.985799 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-User-Domain-Name: Default Jul 14 11:37:11.985799 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-User-Id: e0d5b9edc140499bb612222f6572ae20 Jul 14 11:37:11.985799 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-User-Name: admin Jul 14 11:37:11.985799 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: method: > Jul 14 11:37:11.985799 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: exception: Flavor 42 could not be found. Jul 14 11:37:11.985799 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: action_args: {'id': '42'} Jul 14 11:37:11.985799 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:37:11.985799 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:11.986729 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Jul 14 11:37:11.988055 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-6fa9dfed-14e8-4485-a3b7-b8d9f359e26b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:37:11.989384 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-6fa9dfed-14e8-4485-a3b7-b8d9f359e26b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390321 Jul 14 11:37:11.989384 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jul 14 11:37:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:37:11.995631 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-c60864e7-b4bd-4eca-b21f-4eeb95bc76af admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:12.017451 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-c60864e7-b4bd-4eca-b21f-4eeb95bc76af admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025555 Jul 14 11:37:12.018024 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 14 11:37:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:37:12.028319 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-21e24ef5-1074-4097-b694-cbe2e1e7849c admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:12.050732 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-21e24ef5-1074-4097-b694-cbe2e1e7849c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025884 Jul 14 11:37:12.051313 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 14 11:37:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:37:12.061286 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-9ad72e36-2f30-4166-85a6-652775d937be admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:12.067627 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.wsgi [None req-9ad72e36-2f30-4166-85a6-652775d937be admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-9ad72e36-2f30-4166-85a6-652775d937be admin admin] Request method failure captured: Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Accept: application/json Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Accept-Encoding: gzip, deflate Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Connection: keep-alive Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Content-Length: 0 Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Host: 10.222.0.40 Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Openstack-Api-Version: compute 2.90 Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Openstack-System-Scope: None Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: User-Agent: python-novaclient Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Auth-Token: gAAAAABiz__nAfl7Cn1gD-0ElKYGHzQEucwCpwRDhsci6av2-Z4shV2IGE1bDWmsxiMOvkcTAFmKUXoykqE2TeF2jJKtzJqNmsPpy15XZ5F4D1rx-z5DDKQQilkkcocWUd9UzR7clE0M798kT52S0-AdttnB8o33w08rKYOh613ptK0zsGJ13xE Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Domain-Id: None Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Domain-Name: None Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Identity-Status: Confirmed Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Is-Admin-Project: True Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Project-Domain-Id: default Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Project-Domain-Name: Default Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Project-Id: da372d98ddc34559ac820df9de6d2798 Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Project-Name: admin Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Role: reader,admin,member Jul 14 11:37:12.071753 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Roles: reader,admin,member Jul 14 11:37:12.073319 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da372d98ddc34559ac820df9de6d2798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:37:12.073319 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Tenant: admin Jul 14 11:37:12.073319 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Tenant-Id: da372d98ddc34559ac820df9de6d2798 Jul 14 11:37:12.073319 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Tenant-Name: admin Jul 14 11:37:12.073319 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-User: admin Jul 14 11:37:12.073319 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-User-Domain-Id: default Jul 14 11:37:12.073319 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-User-Domain-Name: Default Jul 14 11:37:12.073319 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-User-Id: e0d5b9edc140499bb612222f6572ae20 Jul 14 11:37:12.073319 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-User-Name: admin Jul 14 11:37:12.073319 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: method: > Jul 14 11:37:12.073319 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: exception: Flavor 42 could not be found. Jul 14 11:37:12.073319 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: action_args: {'id': '42'} Jul 14 11:37:12.073319 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:37:12.073319 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:12.083284 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Jul 14 11:37:12.085060 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-9ad72e36-2f30-4166-85a6-652775d937be admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:37:12.086306 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-9ad72e36-2f30-4166-85a6-652775d937be admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016174 Jul 14 11:37:12.086306 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jul 14 11:37:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:37:13.031889 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-21e24ef5-1074-4097-b694-cbe2e1e7849c admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:13.032913 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-21e24ef5-1074-4097-b694-cbe2e1e7849c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 14 11:37:13.033348 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 11:37:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:37:13.602730 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-b1a33329-7951-409a-b5ec-e7d76e436812 admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:13.608524 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.wsgi [None req-b1a33329-7951-409a-b5ec-e7d76e436812 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-b1a33329-7951-409a-b5ec-e7d76e436812 admin admin] Request method failure captured: Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Accept: application/json Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Accept-Encoding: gzip, deflate Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Connection: keep-alive Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Content-Length: 0 Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Host: 10.222.0.40 Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Openstack-Api-Version: compute 2.90 Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Openstack-System-Scope: None Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: User-Agent: python-novaclient Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Auth-Token: gAAAAABiz__o2M_GQWr5bqPONMLcqa_vCISvgVF6Iceile8U3tZWaiaA6XrxBzofVUtPK4xHn6GLaRwvI1wKuMxdC6H5iVbcQLnQHRPDD67vyYfsDkSf1knN87u0ow8gYmku0sh8jyGa_2wiei0SDJpRksxQjLRRoAz3b2NfZ1XE5p6fo48GVrQ Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Domain-Id: None Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Domain-Name: None Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Identity-Status: Confirmed Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Is-Admin-Project: True Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Project-Domain-Id: default Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Project-Domain-Name: Default Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Project-Id: da372d98ddc34559ac820df9de6d2798 Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Project-Name: admin Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Role: reader,admin,member Jul 14 11:37:13.610102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Roles: reader,admin,member Jul 14 11:37:13.611603 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da372d98ddc34559ac820df9de6d2798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:37:13.611603 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Tenant: admin Jul 14 11:37:13.611603 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Tenant-Id: da372d98ddc34559ac820df9de6d2798 Jul 14 11:37:13.611603 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Tenant-Name: admin Jul 14 11:37:13.611603 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-User: admin Jul 14 11:37:13.611603 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-User-Domain-Id: default Jul 14 11:37:13.611603 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-User-Domain-Name: Default Jul 14 11:37:13.611603 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-User-Id: e0d5b9edc140499bb612222f6572ae20 Jul 14 11:37:13.611603 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-User-Name: admin Jul 14 11:37:13.611603 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: method: > Jul 14 11:37:13.611603 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: exception: Flavor 84 could not be found. Jul 14 11:37:13.611603 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: action_args: {'id': '84'} Jul 14 11:37:13.611603 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:37:13.611603 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:13.612499 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Jul 14 11:37:13.613622 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-b1a33329-7951-409a-b5ec-e7d76e436812 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:37:13.614824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-b1a33329-7951-409a-b5ec-e7d76e436812 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.434498 Jul 14 11:37:13.614824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jul 14 11:37:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:37:13.621571 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-61c8162d-933c-4985-976f-3d570f700e06 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:13.635627 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-61c8162d-933c-4985-976f-3d570f700e06 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017602 Jul 14 11:37:13.636160 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 14 11:37:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:37:13.645395 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-08004088-7a4c-4511-be1b-cd2573cce869 admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:13.658818 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-08004088-7a4c-4511-be1b-cd2573cce869 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016919 Jul 14 11:37:13.659343 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 14 11:37:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:37:13.668682 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-66295623-30fc-443a-b8c7-14d457f3bb24 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:13.674039 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.wsgi [None req-66295623-30fc-443a-b8c7-14d457f3bb24 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-66295623-30fc-443a-b8c7-14d457f3bb24 admin admin] Request method failure captured: Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Accept: application/json Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Accept-Encoding: gzip, deflate Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Connection: keep-alive Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Content-Length: 0 Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Host: 10.222.0.40 Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Openstack-Api-Version: compute 2.90 Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Openstack-System-Scope: None Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: User-Agent: python-novaclient Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Auth-Token: gAAAAABiz__o2M_GQWr5bqPONMLcqa_vCISvgVF6Iceile8U3tZWaiaA6XrxBzofVUtPK4xHn6GLaRwvI1wKuMxdC6H5iVbcQLnQHRPDD67vyYfsDkSf1knN87u0ow8gYmku0sh8jyGa_2wiei0SDJpRksxQjLRRoAz3b2NfZ1XE5p6fo48GVrQ Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Domain-Id: None Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Domain-Name: None Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Identity-Status: Confirmed Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Is-Admin-Project: True Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Project-Domain-Id: default Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Project-Domain-Name: Default Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Project-Id: da372d98ddc34559ac820df9de6d2798 Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Project-Name: admin Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Role: reader,admin,member Jul 14 11:37:13.675541 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Roles: reader,admin,member Jul 14 11:37:13.677087 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da372d98ddc34559ac820df9de6d2798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:37:13.677087 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Tenant: admin Jul 14 11:37:13.677087 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Tenant-Id: da372d98ddc34559ac820df9de6d2798 Jul 14 11:37:13.677087 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Tenant-Name: admin Jul 14 11:37:13.677087 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-User: admin Jul 14 11:37:13.677087 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-User-Domain-Id: default Jul 14 11:37:13.677087 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-User-Domain-Name: Default Jul 14 11:37:13.677087 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-User-Id: e0d5b9edc140499bb612222f6572ae20 Jul 14 11:37:13.677087 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-User-Name: admin Jul 14 11:37:13.677087 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: method: > Jul 14 11:37:13.677087 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: exception: Flavor 84 could not be found. Jul 14 11:37:13.677087 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: action_args: {'id': '84'} Jul 14 11:37:13.677087 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:37:13.677087 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:13.678641 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Jul 14 11:37:13.680033 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-66295623-30fc-443a-b8c7-14d457f3bb24 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:37:13.681278 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-66295623-30fc-443a-b8c7-14d457f3bb24 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011993 Jul 14 11:37:13.681278 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jul 14 11:37:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 14 11:37:14.656313 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-08004088-7a4c-4511-be1b-cd2573cce869 admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:14.657352 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-08004088-7a4c-4511-be1b-cd2573cce869 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 14 11:37:14.657751 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 11:37:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:37:15.189080 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-63feb359-5454-4036-b0b2-9ddc9b09810e admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:15.207213 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.wsgi [None req-63feb359-5454-4036-b0b2-9ddc9b09810e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-63feb359-5454-4036-b0b2-9ddc9b09810e admin admin] Request method failure captured: Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Accept: application/json Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Accept-Encoding: gzip, deflate Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Connection: keep-alive Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Content-Length: 0 Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Host: 10.222.0.40 Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Openstack-Api-Version: compute 2.90 Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Openstack-System-Scope: None Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: User-Agent: python-novaclient Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Auth-Token: gAAAAABiz__qRxBM9JhOFfF-70Ss0Q4R6hexaatzh0Eo4Khm4Ci7f1xOEOOFGpTFNvtrB4tZiFGkKkyge3yGzXLrbs3EUhX6a4_WH6cQs-_DfSkNIGHH7SZ2gJ_fJivGF8dVYegQBew4HGFWn5tZdxxwPe0IsbhQYZzGT-frQvfHjZbAJTAO_lE Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Domain-Id: None Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Domain-Name: None Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Identity-Status: Confirmed Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Is-Admin-Project: True Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Project-Domain-Id: default Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Project-Domain-Name: Default Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Project-Id: da372d98ddc34559ac820df9de6d2798 Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Project-Name: admin Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Role: reader,admin,member Jul 14 11:37:15.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Roles: reader,admin,member Jul 14 11:37:15.210823 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da372d98ddc34559ac820df9de6d2798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:37:15.210823 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Tenant: admin Jul 14 11:37:15.210823 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Tenant-Id: da372d98ddc34559ac820df9de6d2798 Jul 14 11:37:15.210823 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-Tenant-Name: admin Jul 14 11:37:15.210823 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-User: admin Jul 14 11:37:15.210823 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-User-Domain-Id: default Jul 14 11:37:15.210823 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-User-Domain-Name: Default Jul 14 11:37:15.210823 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-User-Id: e0d5b9edc140499bb612222f6572ae20 Jul 14 11:37:15.210823 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: X-User-Name: admin Jul 14 11:37:15.210823 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: method: > Jul 14 11:37:15.210823 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: exception: Flavor 451 could not be found. Jul 14 11:37:15.210823 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: action_args: {'id': '451'} Jul 14 11:37:15.210823 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:37:15.210823 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:15.211816 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: ERROR nova.api.openstack.wsgi Jul 14 11:37:15.213067 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-63feb359-5454-4036-b0b2-9ddc9b09810e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:37:15.214183 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-63feb359-5454-4036-b0b2-9ddc9b09810e admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.415479 Jul 14 11:37:15.214183 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 14 11:37:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:37:15.220636 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-98dbaa27-ccdf-4814-ba82-9ddf5e3c863a admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:15.235328 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-98dbaa27-ccdf-4814-ba82-9ddf5e3c863a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018270 Jul 14 11:37:15.235889 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 14 11:37:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:37:15.245564 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-db877774-fe66-435b-995d-e134a86c7717 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:15.260784 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-db877774-fe66-435b-995d-e134a86c7717 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018696 Jul 14 11:37:15.261355 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 14 11:37:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:37:15.270675 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-d5c9f045-f6e7-4d83-9aaf-0322f1789478 admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:15.276635 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.wsgi [None req-d5c9f045-f6e7-4d83-9aaf-0322f1789478 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-d5c9f045-f6e7-4d83-9aaf-0322f1789478 admin admin] Request method failure captured: Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Accept: application/json Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Accept-Encoding: gzip, deflate Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Connection: keep-alive Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Content-Length: 0 Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Host: 10.222.0.40 Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Openstack-Api-Version: compute 2.90 Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Openstack-System-Scope: None Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: User-Agent: python-novaclient Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Auth-Token: gAAAAABiz__qRxBM9JhOFfF-70Ss0Q4R6hexaatzh0Eo4Khm4Ci7f1xOEOOFGpTFNvtrB4tZiFGkKkyge3yGzXLrbs3EUhX6a4_WH6cQs-_DfSkNIGHH7SZ2gJ_fJivGF8dVYegQBew4HGFWn5tZdxxwPe0IsbhQYZzGT-frQvfHjZbAJTAO_lE Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Domain-Id: None Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Domain-Name: None Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Identity-Status: Confirmed Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Is-Admin-Project: True Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Project-Domain-Id: default Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Project-Domain-Name: Default Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Project-Id: da372d98ddc34559ac820df9de6d2798 Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Project-Name: admin Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Role: reader,admin,member Jul 14 11:37:15.278188 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Roles: reader,admin,member Jul 14 11:37:15.279824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da372d98ddc34559ac820df9de6d2798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da372d98ddc34559ac820df9de6d2798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:37:15.279824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Tenant: admin Jul 14 11:37:15.279824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Tenant-Id: da372d98ddc34559ac820df9de6d2798 Jul 14 11:37:15.279824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-Tenant-Name: admin Jul 14 11:37:15.279824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-User: admin Jul 14 11:37:15.279824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-User-Domain-Id: default Jul 14 11:37:15.279824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-User-Domain-Name: Default Jul 14 11:37:15.279824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-User-Id: e0d5b9edc140499bb612222f6572ae20 Jul 14 11:37:15.279824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: X-User-Name: admin Jul 14 11:37:15.279824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: method: > Jul 14 11:37:15.279824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: exception: Flavor 451 could not be found. Jul 14 11:37:15.279824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: action_args: {'id': '451'} Jul 14 11:37:15.279824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:37:15.279824 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:15.280828 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: ERROR nova.api.openstack.wsgi Jul 14 11:37:15.282187 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-d5c9f045-f6e7-4d83-9aaf-0322f1789478 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:37:15.283401 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-d5c9f045-f6e7-4d83-9aaf-0322f1789478 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012437 Jul 14 11:37:15.283401 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 14 11:37:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:37:16.271212 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-db877774-fe66-435b-995d-e134a86c7717 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:16.272228 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-db877774-fe66-435b-995d-e134a86c7717 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 14 11:37:16.272625 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 11:37:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:37:16.820145 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-9e0c6e8a-bca5-4ea9-ac61-7ab7632e6c6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:37:16.899736 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-9e0c6e8a-bca5-4ea9-ac61-7ab7632e6c6d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.463288 Jul 14 11:37:16.900297 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jul 14 11:37:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 11:37:17.879046 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-db877774-fe66-435b-995d-e134a86c7717 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:17.880068 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-db877774-fe66-435b-995d-e134a86c7717 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 14 11:37:17.880495 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 11:37:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:37:18.414831 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-75d855a4-c8da-4300-b06c-5ce39338ae59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:37:18.493662 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-75d855a4-c8da-4300-b06c-5ce39338ae59 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.476570 Jul 14 11:37:18.494213 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jul 14 11:37:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:37:19.473474 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-db877774-fe66-435b-995d-e134a86c7717 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:19.474559 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-db877774-fe66-435b-995d-e134a86c7717 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jul 14 11:37:19.477891 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 11:37:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:37:20.007583 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-01abae9b-1060-40c7-b077-ac199a02e5c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:37:20.081566 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-01abae9b-1060-40c7-b077-ac199a02e5c5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.466183 Jul 14 11:37:20.082102 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jul 14 11:37:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:37:21.062241 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-db877774-fe66-435b-995d-e134a86c7717 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:21.063254 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-db877774-fe66-435b-995d-e134a86c7717 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 14 11:37:21.063658 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 11:37:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:37:21.598909 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-e15f16d9-94f8-4ad1-8e2a-63eee6f59c06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:37:21.669642 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-e15f16d9-94f8-4ad1-8e2a-63eee6f59c06 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.468159 Jul 14 11:37:21.670124 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jul 14 11:37:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:37:22.639519 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-db877774-fe66-435b-995d-e134a86c7717 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:22.640564 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-db877774-fe66-435b-995d-e134a86c7717 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 14 11:37:22.640959 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 11:37:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:37:23.164947 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-0babc8d0-3f58-4542-b786-ef97fd448e4f admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:23.184628 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-0babc8d0-3f58-4542-b786-ef97fd448e4f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.407600 Jul 14 11:37:23.185462 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Thu Jul 14 11:37:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:38:15.244344 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-db877774-fe66-435b-995d-e134a86c7717 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:38:15.248098 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-db877774-fe66-435b-995d-e134a86c7717 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 14 11:38:15.248098 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 11:38:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:38:15.256336 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG dbcounter [-] [110418] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=110418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:38:15.637585 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-b4f4c553-f642-4df9-acbd-10d6f77aaa8f admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:38:15.657455 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-b4f4c553-f642-4df9-acbd-10d6f77aaa8f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405653 Jul 14 11:38:15.658286 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jul 14 11:38:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:38:15.679375 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG dbcounter [-] [110417] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:38:15.683048 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-38644d4e-d1b2-4ca1-b4d7-aaaa01549b9a admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:38:15.691079 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-38644d4e-d1b2-4ca1-b4d7-aaaa01549b9a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013079 Jul 14 11:38:15.692046 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1282 bytes} [Thu Jul 14 11:38:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:38:15.703052 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-b72d86cb-b1f4-41b3-8635-06b5501aa1c4 admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:38:15.711337 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-b72d86cb-b1f4-41b3-8635-06b5501aa1c4 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011868 Jul 14 11:38:15.712913 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1285 bytes} [Thu Jul 14 11:38:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:38:15.723358 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-5e69c06f-adaf-4f6c-a51e-4bff5d03da45 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:38:15.730822 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-5e69c06f-adaf-4f6c-a51e-4bff5d03da45 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011094 Jul 14 11:38:15.735783 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1285 bytes} [Thu Jul 14 11:38:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:38:15.742897 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-471dff43-bd65-48a5-a073-9be0964c68a2 admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:38:15.750471 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-471dff43-bd65-48a5-a073-9be0964c68a2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011238 Jul 14 11:38:15.750993 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1282 bytes} [Thu Jul 14 11:38:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:41:52.092827 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-5e69c06f-adaf-4f6c-a51e-4bff5d03da45 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:41:52.093887 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-5e69c06f-adaf-4f6c-a51e-4bff5d03da45 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 14 11:41:52.094285 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 11:41:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:41:52.236127 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG dbcounter [-] [110418] Writing DB stats nova_api:SELECT=6 {{(pid=110418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:41:52.400647 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-3467e2fd-9a18-4606-b4a3-b7878dcdf41c admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:41:52.401822 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:41:52.401822 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: warnings.warn(msg) Jul 14 11:41:52.403032 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-3467e2fd-9a18-4606-b4a3-b7878dcdf41c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:41:52.403474 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-3467e2fd-9a18-4606-b4a3-b7878dcdf41c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:41:52.404508 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-3467e2fd-9a18-4606-b4a3-b7878dcdf41c admin admin] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:41:52.404937 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-3467e2fd-9a18-4606-b4a3-b7878dcdf41c admin admin] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:41:52.438764 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-3467e2fd-9a18-4606-b4a3-b7878dcdf41c admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.203981 Jul 14 11:41:52.439341 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 14 11:41:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:41:53.336106 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-5e69c06f-adaf-4f6c-a51e-4bff5d03da45 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:41:53.337119 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-5e69c06f-adaf-4f6c-a51e-4bff5d03da45 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 14 11:41:53.337553 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 11:41:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:41:53.538343 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-26e09052-eb5e-43f2-a21d-77a5a048b80d admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:41:53.539526 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:41:53.539526 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: warnings.warn(msg) Jul 14 11:41:53.540715 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-26e09052-eb5e-43f2-a21d-77a5a048b80d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:41:53.541189 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-26e09052-eb5e-43f2-a21d-77a5a048b80d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:41:53.541981 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-26e09052-eb5e-43f2-a21d-77a5a048b80d admin admin] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:41:53.542436 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-26e09052-eb5e-43f2-a21d-77a5a048b80d admin admin] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:41:53.562414 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-26e09052-eb5e-43f2-a21d-77a5a048b80d admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083471 Jul 14 11:41:53.562916 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 14 11:41:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:42:04.823310 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-5e69c06f-adaf-4f6c-a51e-4bff5d03da45 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:42:04.824311 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-5e69c06f-adaf-4f6c-a51e-4bff5d03da45 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 14 11:42:04.824706 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 11:42:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:42:04.969774 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG dbcounter [-] [110418] Writing DB stats nova_cell0:SELECT=4 {{(pid=110418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:42:04.970517 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG dbcounter [-] [110418] Writing DB stats nova_cell1:SELECT=4 {{(pid=110418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:42:04.971147 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG dbcounter [-] [110418] Writing DB stats nova_api:SELECT=8 {{(pid=110418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:42:05.024061 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-95231a2a-4fd9-4442-9ce3-fa6bd0162773 admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:42:05.032638 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:42:05.032638 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: warnings.warn(msg) Jul 14 11:42:05.032638 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-95231a2a-4fd9-4442-9ce3-fa6bd0162773 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:42:05.032638 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-95231a2a-4fd9-4442-9ce3-fa6bd0162773 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:42:05.032638 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-95231a2a-4fd9-4442-9ce3-fa6bd0162773 admin admin] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:42:05.032638 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-95231a2a-4fd9-4442-9ce3-fa6bd0162773 admin admin] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:42:05.053365 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-95231a2a-4fd9-4442-9ce3-fa6bd0162773 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087943 Jul 14 11:42:05.053935 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 14 11:42:04 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:42:05.874257 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: DEBUG nova.api.openstack.wsgi [None req-5e69c06f-adaf-4f6c-a51e-4bff5d03da45 admin admin] Calling method '>' {{(pid=110417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:42:05.875307 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: INFO nova.api.openstack.requestlog [None req-5e69c06f-adaf-4f6c-a51e-4bff5d03da45 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 14 11:42:05.875702 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: [pid: 110417|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 11:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:42:06.068308 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG nova.api.openstack.wsgi [None req-6ce3cc99-520d-4321-a398-9a462cefec65 admin admin] Calling method '>' {{(pid=110418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:42:06.069519 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:42:06.069519 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: warnings.warn(msg) Jul 14 11:42:06.071226 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-6ce3cc99-520d-4321-a398-9a462cefec65 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:42:06.071662 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-6ce3cc99-520d-4321-a398-9a462cefec65 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:42:06.072441 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-6ce3cc99-520d-4321-a398-9a462cefec65 admin admin] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:42:06.072872 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: DEBUG oslo_concurrency.lockutils [None req-6ce3cc99-520d-4321-a398-9a462cefec65 admin admin] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:42:06.094466 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: INFO nova.api.openstack.requestlog [None req-6ce3cc99-520d-4321-a398-9a462cefec65 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078662 Jul 14 11:42:06.095008 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: [pid: 110418|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 14 11:42:06 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:43:03.439533 dv-cinder-849803-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 11:43:03.440337 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: Thu Jul 14 11:43:03 2022 - graceful shutdown triggered... Jul 14 11:43:03.440842 dv-cinder-849803-1-iscsi devstack@n-api.service[110417]: Gracefully killing worker 1 (pid: 110417)... Jul 14 11:43:03.441244 dv-cinder-849803-1-iscsi devstack@n-api.service[110418]: Gracefully killing worker 2 (pid: 110418)... Jul 14 11:43:04.440594 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: worker 1 buried after 1 seconds Jul 14 11:43:04.440594 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: worker 2 buried after 1 seconds Jul 14 11:43:04.440594 dv-cinder-849803-1-iscsi devstack@n-api.service[110416]: goodbye to uWSGI. Jul 14 11:43:04.442236 dv-cinder-849803-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 14 11:43:04.443018 dv-cinder-849803-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 11:43:04.446433 dv-cinder-849803-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 11:43:04.457533 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 11:43:04.459550 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 11:43:04 2022] *** Jul 14 11:43:04.459550 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 11:43:04.459550 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 11:43:04.459550 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: nodename: dv-cinder-849803-1-iscsi Jul 14 11:43:04.459550 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: machine: x86_64 Jul 14 11:43:04.459550 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: clock source: unix Jul 14 11:43:04.459550 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: pcre jit disabled Jul 14 11:43:04.459550 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: detected number of CPU cores: 4 Jul 14 11:43:04.459550 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: current working directory: / Jul 14 11:43:04.459550 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: detected binary path: /usr/bin/uwsgi-core Jul 14 11:43:04.459550 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: your processes number limit is 47680 Jul 14 11:43:04.459550 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: your memory page size is 4096 bytes Jul 14 11:43:04.459550 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: detected max file descriptor number: 2048 Jul 14 11:43:04.459550 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: lock engine: pthread robust mutexes Jul 14 11:43:04.461411 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: thunder lock: enabled Jul 14 11:43:04.461411 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 11:43:04.461411 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 11:43:04.508767 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: Python main interpreter initialized at 0x55c9265d59c0 Jul 14 11:43:04.508767 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: python threads support enabled Jul 14 11:43:04.508767 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: your server socket listen backlog is limited to 100 connections Jul 14 11:43:04.508767 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: your mercy for graceful operations on workers is 90 seconds Jul 14 11:43:04.509262 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 11:43:04.509262 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: *** Operational MODE: preforking *** Jul 14 11:43:04.509527 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: *** uWSGI is running in multiple interpreter mode *** Jul 14 11:43:04.509527 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: spawned uWSGI master process (pid: 124929) Jul 14 11:43:04.511806 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: spawned uWSGI worker 1 (pid: 124946, cores: 1) Jul 14 11:43:04.511806 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: spawned uWSGI worker 2 (pid: 124947, cores: 1) Jul 14 11:43:04.511806 dv-cinder-849803-1-iscsi devstack@n-api.service[124929]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 11:43:04.509739 dv-cinder-849803-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 11:43:05.174649 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 11:43:05.175228 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 11:43:06.396122 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:43:06.396122 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: from cryptography.utils import int_from_bytes Jul 14 11:43:06.396992 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:43:06.396992 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: from cryptography.utils import int_from_bytes Jul 14 11:43:06.399896 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:43:06.399896 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: from cryptography.utils import int_from_bytes Jul 14 11:43:06.400323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:43:06.400323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: from cryptography.utils import int_from_bytes Jul 14 11:43:08.694416 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:43:08.694947 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:43:08.695127 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:43:08.695515 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:43:08.695769 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:43:08.696166 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.696509 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.696839 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.697177 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.697528 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.697850 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.698181 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.698509 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.698610 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:43:08.699000 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.699096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:43:08.699184 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.699367 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:43:08.699470 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.699733 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849803-1-iscsi {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.699836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:43:08.700538 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:43:08.700653 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.700923 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.701036 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.701268 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.701387 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.701601 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.701707 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.701915 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.702019 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.702244 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.702363 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.702561 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.702663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.702888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.703176 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.704440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.704440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.704716 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.704856 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.705004 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.705151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.705314 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.705454 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849803-1-iscsi {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.705600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.705745 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.705876 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.706038 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.706179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.706318 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.706463 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.706601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.706733 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.706863 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.706996 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.707126 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.707264 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.707398 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.707538 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849803-1-iscsi {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.707679 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.707832 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.707963 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.708093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.708237 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.708369 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.708499 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.708638 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.708771 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.708903 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.709043 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.709206 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.709338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.709459 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.709606 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.709832 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.709977 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.710092 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.710233 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.710380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.710520 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.710659 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.710803 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849803-1-iscsi {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.711036 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.711177 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.711309 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.711448 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.711588 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.711730 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.711862 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.712001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.712141 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.712287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.712419 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.712532 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.712661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.712826 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.712969 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.713115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.713280 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.713412 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.713542 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.713727 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.713864 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.714058 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.714205 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.714391 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.714540 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.714682 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.714834 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.714974 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.715115 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.715256 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.715395 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.715545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.715690 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.715943 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.716088 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.716222 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.716369 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.716492 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.716615 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.716795 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.716925 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.717109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.717282 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.717452 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.717595 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.717769 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.717915 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.718085 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.718219 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.718363 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.718503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.718641 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.718782 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.718913 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.719053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.719195 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.719336 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.719504 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.719641 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.719820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.720049 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.720192 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.720324 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.720455 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.720614 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.720757 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.720962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.721104 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.721316 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.721468 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.721635 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.721783 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.721960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.722096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.722283 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.722417 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.722599 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.722749 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.722914 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.723060 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.723229 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.723371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.723556 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.723704 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.723870 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.724003 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.724187 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.724321 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.724451 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.724592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.724737 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.724875 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.725037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.725198 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.725390 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.725526 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.725707 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.725841 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.726022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.726166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.726344 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.726479 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.726652 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.726794 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.726968 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.727110 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.727283 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.727419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.727596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.728083 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.728083 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.728341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.728486 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.728630 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.728770 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.728902 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.729032 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.729202 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.729336 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.729467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.729609 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.729750 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.729890 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.730036 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.730176 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.730316 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.730456 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.730595 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.730734 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.730880 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.731020 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.731151 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.731282 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.731424 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.731555 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.731685 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.731822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.732002 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.732146 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.732317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.732450 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.732647 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.732790 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.732959 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.733105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.733301 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.733434 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.733610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.733756 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.733927 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.734073 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.734241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.734375 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.734556 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.734692 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.734860 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.734993 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.735181 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.735348 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.735492 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.735632 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.735811 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.735946 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.736178 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.736425 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.736704 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.736840 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.736840 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.737086 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.737239 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.737389 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.737389 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.737651 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.737651 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.737912 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.738043 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.738182 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.738314 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.738452 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.738593 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.738723 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.738869 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.739007 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.739146 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.739286 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.739455 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.739598 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.739765 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.739909 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.740073 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.740217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.740384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.740527 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.740693 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.740840 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.741001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.741143 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.741334 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.741478 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.741661 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.741804 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.741989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.742130 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.742310 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.742460 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.742626 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.742760 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.742939 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.743081 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.743261 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:43:08.743406 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.743604 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.743748 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.743920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.744061 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.744240 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.744387 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.744569 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.744703 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.744896 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.745039 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.745256 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.745393 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.745582 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.745718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.745904 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.746047 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.746300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.746445 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.746583 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.747231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.747380 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.747519 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.747704 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.747857 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.748069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.748216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.748349 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.748479 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.748659 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.748805 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.748995 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.749130 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.749372 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.749508 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.749647 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.749794 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.749970 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.750103 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.750288 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.750431 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.750615 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.750763 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.750937 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.751069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.751268 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.751402 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.751589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.751732 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.751918 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.752059 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.752248 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.752390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.752573 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.752708 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.752896 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.753030 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.753285 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.753431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.753578 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.753718 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.753850 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.753982 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.754173 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.754317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.754505 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.754648 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.754829 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.754962 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.755153 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.755302 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.755480 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.755622 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.755946 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.756122 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.756264 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.756498 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.756640 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.756779 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.756911 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.757048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.757220 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.757378 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.757514 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.757698 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.757842 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.758045 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.758216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.758337 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.758544 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.758672 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.758874 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.759011 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.759211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.759342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.759535 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.759656 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.759857 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.759996 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.760172 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.760294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.760486 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.760624 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.760837 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.760986 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.761111 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.761295 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.761431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.761566 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.761754 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.761883 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.762091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.762221 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.762978 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.763108 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.763322 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.764513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.764678 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.764816 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.764957 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.765091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.765319 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.765456 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.765597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.765729 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.765871 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.766013 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.766163 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.766303 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.766443 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.766608 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.766741 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.766880 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.767022 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.767158 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.767290 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.767428 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.767568 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.767709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.767847 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.767986 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.768117 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.768255 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.768387 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.768532 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.768672 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.768813 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.768951 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.769083 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.769237 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.769492 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.769635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.769769 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.769908 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.770040 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.770179 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.770325 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.770457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.770589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.770720 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.770859 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.771004 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.771136 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.771274 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.771415 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.771546 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.771678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.771678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.771949 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.772088 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.772227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.772358 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.772488 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.772621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.772751 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.772892 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.773023 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.773190 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.773324 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.773478 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.773622 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.773754 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.773887 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.774018 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.774157 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.774338 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.774482 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.774648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.774782 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.774962 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.775106 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.775276 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.775660 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.775843 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.775987 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.776174 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.776318 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.776491 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.776627 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.776805 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.776941 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.777118 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.777289 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.777462 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.777607 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.777793 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.777946 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.778146 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.778288 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.778496 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.778632 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.778830 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.778971 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.779153 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.779296 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.779481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.779615 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.779800 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.779933 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.780121 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.780264 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.780434 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.780574 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.780752 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.780894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.781075 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.781248 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.781420 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.781556 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.781749 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.781884 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.782071 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.782207 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.782401 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.782545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.782722 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.782865 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.783042 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.783185 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.783360 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.783493 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.783679 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.783827 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.783990 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.784133 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.784317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.784499 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.784642 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.784950 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.785293 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.785595 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.785759 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.785935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.786085 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.786245 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.786390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.786566 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.786718 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.786876 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.787036 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.787208 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.787367 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.787542 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.787700 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.787845 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.788002 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.788148 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.788300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.788476 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.788633 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.788787 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.789052 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.789358 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.789495 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.789699 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.789836 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.790025 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.790173 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.790343 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.790486 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.790664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.790806 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.791132 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.791270 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.791270 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.791530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.791661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.791792 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.791933 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.792064 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.792259 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.792415 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.792572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.792713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.792858 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.792998 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.793184 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.793329 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.793546 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.793729 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.793870 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.794001 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.794180 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.794317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.794520 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.794664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.794880 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.795017 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.800897 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.801730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.801730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.802020 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.802020 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.802278 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.802418 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.802560 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.802702 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.802843 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.802843 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.803100 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.803235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.803366 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.803366 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.803638 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.803781 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.803915 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.804057 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.804190 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.804337 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.804478 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.804697 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.804839 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.804972 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.805119 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.805286 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.805422 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.805545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.805666 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.805787 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.805914 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.806036 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.806158 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.806315 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.806443 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.806564 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.806714 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.806847 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.806987 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.807118 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.807118 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.807402 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.807551 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.807696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.807837 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.807978 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.808117 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.808264 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.808264 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.808558 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.808558 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.808814 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.808814 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.809088 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.809088 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.809958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.810099 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.810244 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.810384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.810527 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.810662 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.810662 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.810945 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.811086 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.811219 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.811364 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.811505 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.811640 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.811779 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.811919 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.812066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.812200 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.812340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.812340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.812590 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.812723 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.812862 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.812862 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.813112 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.813260 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.813406 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.813554 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.813695 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.813695 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.813953 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.814095 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.814228 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.814360 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.814360 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.814616 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.814756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.814897 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.815031 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.815169 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.815311 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.815443 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.815576 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.815716 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.815851 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.815981 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.816120 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.816260 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.816400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.816541 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.816675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.816815 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.816959 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.817092 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.817247 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.817381 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.817513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.817652 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.817798 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.817932 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.818079 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.818219 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.818353 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.818483 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.818624 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.818756 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.818897 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.819031 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.819163 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.819306 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.819440 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.819583 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.819716 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.819856 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.819990 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.820138 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.820280 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.820420 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.820553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.820683 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.820822 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.821005 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.821140 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.821305 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.821422 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.821560 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.821693 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.821837 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.821970 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.822102 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.822233 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.822372 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.822519 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.822652 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.822784 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.822915 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.823055 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.823188 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.823329 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.823469 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.823621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.823753 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.823885 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.824024 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.824171 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.824304 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.824443 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.824583 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.824716 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.824904 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.825563 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.825697 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.825829 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.825960 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.826099 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.826246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.826395 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.826529 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.826668 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.826800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.826939 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.827085 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.827219 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.827359 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.827492 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.827622 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.827762 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.827977 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.828120 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.828260 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.828402 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.828526 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.828648 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.828771 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.828893 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.829006 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.829126 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.829271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.829397 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.829519 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.829640 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.829765 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.829880 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.829992 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.830118 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.830233 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.830367 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.830500 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.830631 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.830770 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.830913 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.831054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.831195 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.831327 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.831467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.831609 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.831757 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.831889 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.832021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.832152 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.832291 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.832437 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.832581 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.832713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.832853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.832992 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.832992 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.833279 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.833399 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.833399 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.833399 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.833399 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.833399 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.834019 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.834220 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.834340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.834452 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.834565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.834565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.834786 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.834917 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.835038 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.835161 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.835349 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.835481 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.835481 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.835481 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.835807 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.835927 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.836040 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.836166 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.836288 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.836412 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.836525 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.836647 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.836770 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.836893 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.837006 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.837126 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.837262 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.837545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.837864 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.838179 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.838493 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.838829 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.839149 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.839433 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.839570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.839765 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.839894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.840077 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.840210 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.840530 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.840676 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.840800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.840922 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.841125 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.841373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.841512 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.841652 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.841821 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.841964 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.842155 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.842296 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.842486 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.842638 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.842816 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.842943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.843137 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.843273 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.843438 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.843581 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.843779 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.843924 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.844113 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.844280 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.844440 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.844613 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.844813 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.844958 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.845143 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.845315 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.845464 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.845629 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.845764 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.845896 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.846071 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.846208 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.846399 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.846543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.846721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.846857 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.847045 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.847181 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.847366 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.847504 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.847689 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.847819 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.848012 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.848160 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.848335 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.848473 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.848660 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.848795 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.849088 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.849288 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.849410 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.849532 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.849653 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.849785 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.849947 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.850092 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.850267 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.850413 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.850644 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.850789 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.850941 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.851075 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.851206 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.851339 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.851525 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.851662 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.851841 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.851978 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.852162 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.852297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.852476 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.852619 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.852881 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.853023 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.853274 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.853597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.853736 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.853911 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.854233 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.854523 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.854654 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.854866 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.855009 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.855189 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.855325 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.855504 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.856086 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.856233 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.856357 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.856480 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.856594 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.856709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.856821 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.856942 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.857119 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.857327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.857510 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.857655 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.857842 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.857980 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.858175 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.858320 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.858490 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.858626 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.858807 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.858940 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.859121 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.859272 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.859450 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.859593 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.859765 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.859910 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.860095 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.860239 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.860458 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.860593 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.860781 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.861007 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.861180 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.865301 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.865404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.865494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.865573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.865654 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.865739 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.865820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.865892 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.865965 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.866035 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.866115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.866194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.866276 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.866356 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.866429 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.866500 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.866580 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.866660 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.866733 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.866733 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.866861 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.866947 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.867114 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.867204 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.867284 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.867364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.867464 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.867551 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.867643 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.867736 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.867829 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.867921 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.868014 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.868100 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.868191 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.868277 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.868368 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.868368 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.868531 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.868626 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.868719 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.868810 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.868902 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.868994 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.869088 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.869196 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.869281 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.869354 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.869439 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.869536 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.869611 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.869694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.869785 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.869878 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.869970 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.870063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.870147 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.870381 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.870485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.870696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.870799 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.871019 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.871126 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.872391 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.872482 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.872566 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.872649 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.872739 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.872835 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.872923 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.873006 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.873104 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.873281 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.873415 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.873600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.873774 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.873928 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.874095 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.874251 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.874406 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.874563 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.874717 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.874883 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.875044 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.875208 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.875358 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.875505 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.875651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.875803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.875963 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.876111 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.876264 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.876418 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.876563 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.876737 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.876885 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.877031 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.877206 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.877370 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.877524 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.877681 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.877835 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.877982 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.878126 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.878281 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.878427 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.878586 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.878745 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.878900 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.879054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.879207 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.879352 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.879508 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.879710 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.879874 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.880020 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.880176 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.880333 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.880487 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.880641 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.880806 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.880962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.881119 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.881307 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.881463 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.881619 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.881775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.881923 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.882075 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.882231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.882377 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.882530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.882686 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.882832 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.882986 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.883133 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.883277 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.883431 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.883578 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.883738 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.883894 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.884048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.884195 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.884347 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.884555 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.884701 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.884829 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.884953 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.885076 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.885230 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.885349 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.898300 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.898481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.898622 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.898755 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.898870 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.898983 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.899183 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.899299 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.899419 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.899540 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.899540 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.899753 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.899879 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.899994 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.900098 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.900195 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.900282 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.900622 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.900766 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.900875 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.900971 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.901065 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.901207 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.901300 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.901405 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.901494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.901579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.901663 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.901748 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.901838 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.901933 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.902021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.902113 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.902199 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.902285 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.902384 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.902471 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.902563 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.902650 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.902734 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.902819 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.902934 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.903032 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.903121 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.903206 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.903298 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.903384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.903478 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.903573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.903661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.903753 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.903753 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.904068 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.904068 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.904252 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.904341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.904609 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.904708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.904810 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.904899 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.904985 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.905069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.905182 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.905272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.905372 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.905469 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.905564 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.905650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.905736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.905821 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.905919 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.906041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.906116 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.906195 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.906283 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.906378 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.906466 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.906553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.906640 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.906735 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.906821 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.906916 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.907008 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.907083 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.907162 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.907263 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.907359 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.907455 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.907549 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.907639 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.907714 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.907800 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.907800 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.907971 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.908065 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.908152 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.908248 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.908344 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.908439 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.908525 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.908619 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.908712 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.908805 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.908904 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.908991 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.909075 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.909183 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.909271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.909368 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.909464 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.909551 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.909642 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.909728 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.909820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.909921 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.910007 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.910007 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.910170 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.910263 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.910411 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.910512 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.910608 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.910695 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.910695 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.910858 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.910951 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.911050 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.911137 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.911223 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.911308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.911412 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.911499 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.911594 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.911594 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.911767 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.911862 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.911956 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.912052 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.912138 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.912232 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.912318 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.912404 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.912503 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.912603 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.912691 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.912784 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.912877 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.912963 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.913055 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.913151 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.913254 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.913340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.913424 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.913523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.913610 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.913610 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.913783 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.913876 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.913970 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.914072 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.914176 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.914272 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.914360 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.914445 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.914770 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.914871 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.914969 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.915057 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.915143 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.915143 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.915313 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.915401 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.915495 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.915590 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.915676 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.915761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.915854 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.915955 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.916049 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.916144 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.916239 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.916327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.916411 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.916511 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.916511 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.916677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.916763 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.916848 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.916933 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.917099 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.917217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.917294 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.917380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.917464 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.917642 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.917749 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.917952 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.918055 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.918269 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.918373 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.918610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.918710 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.918922 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.919017 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.919232 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.919336 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.919544 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.919647 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.919863 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.919957 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.920176 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.920269 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.920489 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.920592 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.920799 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.920893 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.921116 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.921241 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.921453 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.921547 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.921762 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.921855 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.922118 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.922250 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.922450 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.922611 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.922762 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.923106 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.923209 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.923294 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.923376 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.923682 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.924014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.924349 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.924450 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.924746 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.924853 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.925025 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.925122 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.925343 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.925889 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.926009 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.926235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.926383 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.926566 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.926868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.926971 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.927239 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.927442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.927692 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.928020 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.928362 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.928691 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.929032 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.933252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.933383 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.933383 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.933553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.933641 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.933718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.933792 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.933873 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.933873 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.934015 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.934100 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.934676 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.934761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.934835 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.934924 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.935059 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.935205 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.935300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.935376 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.935456 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.935538 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.935621 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.935696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.935776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.935849 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.935929 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.936011 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.936236 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.936346 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.936435 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.936435 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.936435 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.936637 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.936637 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.936637 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.936847 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.936929 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.937004 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.937091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.937198 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.937290 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.937382 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.937458 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.937538 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.937629 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.937711 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.938485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.938596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.938674 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.938754 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.938841 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.938916 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.938988 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.939062 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.939694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.939810 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.939898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.939973 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.940055 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.940160 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.940244 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.940328 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.940896 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.940996 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.941082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.941209 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.941300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.941394 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.941477 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.941848 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.941946 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.942022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.942117 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.942278 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.942379 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.942716 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.942821 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.942898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.942981 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.943253 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.943361 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.943553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.943655 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.943876 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.943991 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.944228 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.944329 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.944659 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.944761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.944961 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.945319 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.945436 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.945679 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.945973 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.946086 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.946301 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.946412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.946622 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.946730 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.946952 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.947059 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.947273 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.947381 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.947587 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.947687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.947903 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.948022 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.948265 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.948577 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.948752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.948916 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.949074 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.949268 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.949468 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.949575 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.949810 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.949948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.950695 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.950869 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.951060 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.951155 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.951340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.951435 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.951611 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.951720 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.951921 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.952029 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.953417 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.953514 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.953613 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.953689 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.953764 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.953836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.953917 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.953991 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.954073 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.954148 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.954221 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.954293 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.954366 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.954438 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.954525 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.954601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.954674 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.955615 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.955732 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.955732 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.955882 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.955957 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.956044 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.956044 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.956563 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.956678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.956756 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.956839 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.956913 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.957269 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.957371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.957471 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.957548 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.957794 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.957889 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.958079 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.958182 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.958943 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.959054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.959133 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.959216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.959291 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.959380 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.959465 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.959547 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.959633 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.960075 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.960174 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.960265 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.960342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.960423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.960511 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.960839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.960945 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.961037 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.961249 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.961408 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.961503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.961689 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.961954 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.962073 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.962304 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.962404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.962625 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.962733 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.962956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.963056 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.963282 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.963390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.963597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.963696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.963931 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.964039 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.964251 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.964350 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.964571 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.964693 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.964968 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.965069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.965288 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.965534 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.965794 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.965914 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.966171 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.966403 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.966502 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.966680 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.966839 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.967101 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.967262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.967430 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.967584 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.967736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.967891 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.968051 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.968216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.968378 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.968539 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.968692 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.968853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.969016 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.969241 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.969447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.969606 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.969759 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.969920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.970083 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.970244 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.970406 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.970572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.970730 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.970898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.971061 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.971222 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.971382 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.971556 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.971718 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.971890 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:43:08.972053 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.972225 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.972428 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.972752 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.973070 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:43:08.973371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:43:09.131335 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO dbcounter [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] Registered counter for database nova_api Jul 14 11:43:09.132237 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO dbcounter [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] Registered counter for database nova_api Jul 14 11:43:09.153765 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124947) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:43:09.155279 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_db.sqlalchemy.engines [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124946) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:43:09.160569 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writer thread running {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:43:09.161922 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writer thread running {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:43:09.217568 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.context [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7a7b1c5-183a-455b-a224-c19c749ad259(cell1) {{(pid=124947) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 11:43:09.219908 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.context [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7a7b1c5-183a-455b-a224-c19c749ad259(cell1) {{(pid=124946) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 11:43:09.221610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:43:09.223187 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:43:09.224006 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:43:09.224123 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:43:09.225605 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:43:09.226023 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:43:09.226432 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:43:09.228004 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO dbcounter [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] Registered counter for database nova_cell0 Jul 14 11:43:09.228439 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:43:09.230466 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO dbcounter [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] Registered counter for database nova_cell0 Jul 14 11:43:09.232161 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO dbcounter [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] Registered counter for database nova_cell1 Jul 14 11:43:09.234550 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO dbcounter [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] Registered counter for database nova_cell1 Jul 14 11:43:09.244633 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124947) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:43:09.244852 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_db.sqlalchemy.engines [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124946) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:43:09.245339 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_db.sqlalchemy.engines [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124946) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:43:09.245461 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124947) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:43:09.248077 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writer thread running {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:43:09.252599 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writer thread running {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:43:09.253971 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writer thread running {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:43:09.393302 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writer thread running {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:43:09.403956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO dbcounter [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] Registered counter for database nova_cell0 Jul 14 11:43:09.404746 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO dbcounter [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] Registered counter for database nova_cell0 Jul 14 11:43:09.412346 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124947) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:43:09.413622 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_db.sqlalchemy.engines [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124946) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:43:09.417858 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writer thread running {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:43:09.418312 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writer thread running {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:43:09.748280 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: WARNING keystonemiddleware.auth_token [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:43:09.749609 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: WARNING keystonemiddleware.auth_token [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:43:09.755731 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: WARNING keystonemiddleware.auth_token [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:43:09.756827 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: WARNING keystonemiddleware.auth_token [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:43:10.103589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: WARNING keystonemiddleware.auth_token [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:43:10.106915 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: WARNING keystonemiddleware.auth_token [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:43:10.109941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: WARNING keystonemiddleware.auth_token [None req-df26ef67-503e-43f9-8c15-97f8b79f12cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:43:10.113136 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: WARNING keystonemiddleware.auth_token [None req-d7e5286e-95ab-4d21-8108-7a9d5e5e578e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:43:10.115955 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c9265d59c0 pid: 124946 (default app) Jul 14 11:43:10.119682 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c9265d59c0 pid: 124947 (default app) Jul 14 11:44:08.085502 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=3 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:08.087593 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=3 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:08.088763 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=3 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:08.090100 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=3 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:08.742326 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=3 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:08.747881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=3 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:08.749846 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=3 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:08.750994 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=3 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:09.874098 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1055884248", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "networks": [{"uuid": "7743558a-c4dc-432c-9b5b-7c02f455d982"}]}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:10.500356 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6f6bf093-bae4-4159-934e-fba639ed7850 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Action: 'create', calling method: .version_select at 0x7f1ae5651c10>, body: {"keypair": {"name": "tempest-keypair-1024945688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgZRnDMI4RGBAbRnOKocTWz9YWMS08Jm+Wpu1G3p+ScpQbot+vzobkoQh4MKX+8hUobHZAj0eALe2B+vPGvx8qNunQliiFofYm15hJT68lStl1ZYF8sm9M8gTE29afnkg=="}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:10.600862 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-6f6bf093-bae4-4159-934e-fba639ed7850 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Getting quotas for project 48a88ac7db8a481ca03508d315a0bc56. Resources: {'key_pairs'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:44:10.622558 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-6f6bf093-bae4-4159-934e-fba639ed7850 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Getting quotas for user 246f07024efa444da74f2b898f426b46 and project 48a88ac7db8a481ca03508d315a0bc56. Resources: {'key_pairs'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:44:10.953725 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6f6bf093-bae4-4159-934e-fba639ed7850 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 2.229519 Jul 14 11:44:10.957086 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 11:44:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:44:11.489628 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.network.neutron [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] validate_networks() for [('7743558a-c4dc-432c-9b5b-7c02f455d982', None, None, None, None, None)] {{(pid=124946) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:44:13.192710 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-61b2d1fb-553e-42ad-ae83-71ebf8d83b6e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Action: 'create', calling method: .version_select at 0x7f1ae552c160>, body: {"keypair": {"name": "tempest-keypair-1480488436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByJIdSg+B5ZsvTcXeLd91ufKRMXOPUjMJm5WFV1R+rxxMj0O1q+8aXClMM9TCZDK8JagSLNdj7kc5TWBvSJnupkxQVxmadgHjQCQltGUU6kqirDyVr2/P9hfav7ZYYLnw=="}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:13.213533 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-61b2d1fb-553e-42ad-ae83-71ebf8d83b6e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Getting quotas for project 81777430895b432999f69033667e59f1. Resources: {'key_pairs'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:44:13.231945 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-61b2d1fb-553e-42ad-ae83-71ebf8d83b6e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Getting quotas for user 899cbac79d874b308b500651bb40b2a7 and project 81777430895b432999f69033667e59f1. Resources: {'key_pairs'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:44:13.380810 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-61b2d1fb-553e-42ad-ae83-71ebf8d83b6e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.739822 Jul 14 11:44:13.385032 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 2/2] 10.222.0.40 () {62 vars in 1199 bytes} [Thu Jul 14 11:44:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 743 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 14 11:44:14.500014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-0be70f89-bd8b-4314-a903-c48dc1aa1436 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Action: 'create', calling method: .version_select at 0x7f1ae4cdd280>, body: {"keypair": {"name": "tempest-keypair-1718795879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKABKxC2iB6ixy3oP1Oe924eeaLqBRWIzzv7pBbyCYsTVDoQMKnF8J+6UHbbWAY96QXOLoFVy6LVwMhpuTY/FIWF+3XAReMVjD1+z6YvIpAIf9OZ/RBsfi1ARLhEe5DnRg=="}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:14.536767 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-0be70f89-bd8b-4314-a903-c48dc1aa1436 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for project f274d555f5c746cc885394c699b3d767. Resources: {'key_pairs'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:44:14.542273 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Flavor limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:44:14.542771 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Image limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:44:14.543352 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Flavor pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:44:14.544714 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Image pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:44:14.545483 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:44:14.571597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:14.571597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:14.571597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:14.571597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:14.571927 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-0be70f89-bd8b-4314-a903-c48dc1aa1436 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for user 8773c88f88614a9d903f667305a217e0 and project f274d555f5c746cc885394c699b3d767. Resources: {'key_pairs'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:44:14.648778 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Getting quotas for project 5bb446eb04c04b73aacbcf5e605a6c76. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:44:14.662859 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Getting quotas for user 760c5416ab5c44a59eb03971c2252725 and project 5bb446eb04c04b73aacbcf5e605a6c76. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:44:14.679576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Going to run 1 instances... {{(pid=124946) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:44:14.683156 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124946) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:44:14.737694 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-0be70f89-bd8b-4314-a903-c48dc1aa1436 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.656830 Jul 14 11:44:14.738420 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 3/3] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 11:44:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:44:14.854532 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b555f3b0-9235-4355-80f5-f535c7b58fcb tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.771272 Jul 14 11:44:14.855251 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 1/4] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:44:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 6782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:44:14.866452 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-dc6b9457-d49e-4450-bc3b-f360a45b8954 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:14.867212 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-dc6b9457-d49e-4450-bc3b-f360a45b8954 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:16.330777 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-dc6b9457-d49e-4450-bc3b-f360a45b8954 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:16.384319 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-dc6b9457-d49e-4450-bc3b-f360a45b8954 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1215 microversion: 2.1 time: 1.521700 Jul 14 11:44:16.384956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 4/5] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:14 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1215 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:17.105341 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-185782156", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87d6f20b-bda5-4229-8026-f520c7f094ed"}], "security_groups": [{"name": "tempest-securitygroup--1977881625"}], "key_name": "tempest-keypair-1024945688", "user_data": "}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:17.356389 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.network.neutron [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] validate_networks() for [('87d6f20b-bda5-4229-8026-f520c7f094ed', None, None, None, None, None)] {{(pid=124946) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:44:17.404092 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b9b99674-1ea4-4db8-866d-fc1786fcfee2 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:17.404952 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b9b99674-1ea4-4db8-866d-fc1786fcfee2 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:17.487480 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b9b99674-1ea4-4db8-866d-fc1786fcfee2 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:17.497617 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b9b99674-1ea4-4db8-866d-fc1786fcfee2 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1215 microversion: 2.1 time: 0.098892 Jul 14 11:44:17.509444 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 5/6] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:17 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1215 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:18.216865 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Flavor limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:44:18.217446 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Image limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:44:18.218051 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Flavor pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:44:18.218513 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Image pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:44:18.218936 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:44:18.237892 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:18.238377 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:18.239323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:18.239766 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:18.285382 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Getting quotas for project 48a88ac7db8a481ca03508d315a0bc56. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:44:18.290010 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Getting quotas for user 246f07024efa444da74f2b898f426b46 and project 48a88ac7db8a481ca03508d315a0bc56. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:44:18.305833 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Going to run 1 instances... {{(pid=124946) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:44:18.308050 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124946) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:44:18.509717 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ba37d176-a6d5-4276-8971-923a0e9b4270 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.409950 Jul 14 11:44:18.511588 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 2/7] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:44:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 1413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:44:18.522223 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-815c0984-86fe-4586-83cb-bce03d93c8e1 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:18.527862 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-815c0984-86fe-4586-83cb-bce03d93c8e1 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:18.535944 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-f7298fda-3a9a-41a6-9842-252d401ad209 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:18.536572 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-f7298fda-3a9a-41a6-9842-252d401ad209 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:18.542862 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-815c0984-86fe-4586-83cb-bce03d93c8e1 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:18.568610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-815c0984-86fe-4586-83cb-bce03d93c8e1 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:18.569813 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-815c0984-86fe-4586-83cb-bce03d93c8e1 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:18.570439 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-815c0984-86fe-4586-83cb-bce03d93c8e1 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:18.746247 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f7298fda-3a9a-41a6-9842-252d401ad209 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:18.769026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-f7298fda-3a9a-41a6-9842-252d401ad209 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1237 microversion: 2.1 time: 0.246545 Jul 14 11:44:18.782892 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 3/8] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:18 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1237 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:18.930021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-815c0984-86fe-4586-83cb-bce03d93c8e1 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:18.967982 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-815c0984-86fe-4586-83cb-bce03d93c8e1 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1219 microversion: 2.1 time: 0.452319 Jul 14 11:44:18.969202 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 6/9] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:18 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1219 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:19.299148 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-304280981", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4586847-6136-4dce-945a-818d63fc4328"}], "security_groups": [{"name": "tempest-securitygroup--1296217109"}], "key_name": "tempest-keypair-1480488436", "user_data": "}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:19.427471 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.network.neutron [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] validate_networks() for [('e4586847-6136-4dce-945a-818d63fc4328', None, None, None, None, None)] {{(pid=124946) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:44:19.585511 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-720271898", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce6397ea-e1d9-4c18-9185-6161e76618d7"}], "security_groups": [{"name": "tempest-securitygroup--1517899033"}], "key_name": "tempest-keypair-1718795879", "user_data": "}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:19.872729 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.network.neutron [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] validate_networks() for [('ce6397ea-e1d9-4c18-9185-6161e76618d7', None, None, None, None, None)] {{(pid=124947) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:44:20.126687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Flavor limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:44:20.126687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Image limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:44:20.126687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Flavor pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:44:20.126687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Image pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:44:20.126687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:44:20.143013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:20.143568 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:20.148220 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:20.154189 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:20.207716 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Getting quotas for project 81777430895b432999f69033667e59f1. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:44:20.218383 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Getting quotas for user 899cbac79d874b308b500651bb40b2a7 and project 81777430895b432999f69033667e59f1. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:44:20.238451 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Going to run 1 instances... {{(pid=124946) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:44:20.240036 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124946) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:44:20.461215 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-7f558ad5-bbe7-4989-843e-96dd454f338a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.156151 Jul 14 11:44:20.462297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 4/10] 10.222.0.40 () {62 vars in 1187 bytes} [Thu Jul 14 11:44:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 11:44:20.468789 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-43c41b50-9782-4368-a13d-b3964b27898b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:20.469603 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-43c41b50-9782-4368-a13d-b3964b27898b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:20.621626 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-43c41b50-9782-4368-a13d-b3964b27898b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:20.633517 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-43c41b50-9782-4368-a13d-b3964b27898b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1237 microversion: 2.1 time: 0.168403 Jul 14 11:44:20.659346 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 5/11] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:20 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1237 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:20.670722 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-28402a64-53ed-4f19-8f1a-9f692a078f65 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:20.675594 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-28402a64-53ed-4f19-8f1a-9f692a078f65 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:20.694340 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-28402a64-53ed-4f19-8f1a-9f692a078f65 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:20.697749 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-28402a64-53ed-4f19-8f1a-9f692a078f65 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:20.701015 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-28402a64-53ed-4f19-8f1a-9f692a078f65 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:20.701668 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-28402a64-53ed-4f19-8f1a-9f692a078f65 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:21.154651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-28402a64-53ed-4f19-8f1a-9f692a078f65 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:21.187984 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-28402a64-53ed-4f19-8f1a-9f692a078f65 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1275 microversion: 2.1 time: 0.526628 Jul 14 11:44:21.194134 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:20 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1275 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:21.201639 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-1f08296d-378a-4c6d-ad90-69f38e15e032 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:21.202261 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-1f08296d-378a-4c6d-ad90-69f38e15e032 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:21.317052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-1f08296d-378a-4c6d-ad90-69f38e15e032 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:21.328138 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-1f08296d-378a-4c6d-ad90-69f38e15e032 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:21.331553 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-1f08296d-378a-4c6d-ad90-69f38e15e032 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:21.333546 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-1f08296d-378a-4c6d-ad90-69f38e15e032 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1281 microversion: 2.20 time: 0.138042 Jul 14 11:44:21.334976 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 7/13] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:21 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1281 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:21.501843 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Flavor limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:44:21.502422 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Image limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:44:21.502736 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Flavor pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:44:21.503148 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Image pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:44:21.503681 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:44:21.521990 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:21.522436 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:21.525899 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:21.525899 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:21.571023 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for project f274d555f5c746cc885394c699b3d767. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:44:21.575437 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for user 8773c88f88614a9d903f667305a217e0 and project f274d555f5c746cc885394c699b3d767. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:44:21.594130 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Going to run 1 instances... {{(pid=124947) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:44:21.597628 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:44:21.654455 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d2d2e7d4-38d6-4730-adb4-b793f4f9a83c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:21.655209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d2d2e7d4-38d6-4730-adb4-b793f4f9a83c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:21.669364 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d2d2e7d4-38d6-4730-adb4-b793f4f9a83c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:21.669364 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d2d2e7d4-38d6-4730-adb4-b793f4f9a83c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:21.669364 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d2d2e7d4-38d6-4730-adb4-b793f4f9a83c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:21.670588 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d2d2e7d4-38d6-4730-adb4-b793f4f9a83c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:21.819161 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d2d2e7d4-38d6-4730-adb4-b793f4f9a83c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:21.834910 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d2d2e7d4-38d6-4730-adb4-b793f4f9a83c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1233 microversion: 2.1 time: 0.182531 Jul 14 11:44:21.835058 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-42fbed8e-dd9f-4d9a-9922-daa08b05fc67 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.258186 Jul 14 11:44:21.835058 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 7/15] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:44:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 2260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 11:44:21.835238 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 8/15] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:21 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1233 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:44:21.858682 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5ad7d7f9-0be6-40da-ad09-467c5a4d94c9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:21.860815 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-5ad7d7f9-0be6-40da-ad09-467c5a4d94c9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:21.960506 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-5ad7d7f9-0be6-40da-ad09-467c5a4d94c9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:21.976071 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-5ad7d7f9-0be6-40da-ad09-467c5a4d94c9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1241 microversion: 2.1 time: 0.125371 Jul 14 11:44:21.987748 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:21 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1241 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:22.214672 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-0feed68b-553e-4c46-b896-1e288a56cd5c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:22.215427 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-0feed68b-553e-4c46-b896-1e288a56cd5c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:22.227724 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0feed68b-553e-4c46-b896-1e288a56cd5c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:22.231008 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0feed68b-553e-4c46-b896-1e288a56cd5c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:22.233849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0feed68b-553e-4c46-b896-1e288a56cd5c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:22.237787 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0feed68b-553e-4c46-b896-1e288a56cd5c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:22.361880 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-4d63459a-ebfb-4d25-829d-eaee4eb1829b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:22.362619 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-4d63459a-ebfb-4d25-829d-eaee4eb1829b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:22.512995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-4d63459a-ebfb-4d25-829d-eaee4eb1829b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:22.526750 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-4d63459a-ebfb-4d25-829d-eaee4eb1829b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:22.528921 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-4d63459a-ebfb-4d25-829d-eaee4eb1829b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:22.530105 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-4d63459a-ebfb-4d25-829d-eaee4eb1829b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1281 microversion: 2.20 time: 0.172636 Jul 14 11:44:22.530761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 9/17] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:22 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1281 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:44:22.592071 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-0feed68b-553e-4c46-b896-1e288a56cd5c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:22.601139 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-0feed68b-553e-4c46-b896-1e288a56cd5c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1273 microversion: 2.1 time: 0.394028 Jul 14 11:44:22.601675 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 9/18] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:22 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1273 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:22.855018 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-492bd2f5-4388-452b-8892-c753706dc97f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:22.856085 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-492bd2f5-4388-452b-8892-c753706dc97f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:22.891813 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-492bd2f5-4388-452b-8892-c753706dc97f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:22.892279 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-492bd2f5-4388-452b-8892-c753706dc97f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:22.893075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-492bd2f5-4388-452b-8892-c753706dc97f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:22.903887 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-492bd2f5-4388-452b-8892-c753706dc97f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:23.000594 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5b1f5415-c393-495f-a056-382fb505532f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:23.002694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5b1f5415-c393-495f-a056-382fb505532f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:23.096689 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-492bd2f5-4388-452b-8892-c753706dc97f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:23.119156 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-492bd2f5-4388-452b-8892-c753706dc97f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1289 microversion: 2.1 time: 0.268338 Jul 14 11:44:23.123980 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 10/19] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:22 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1289 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:23.174095 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5b1f5415-c393-495f-a056-382fb505532f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:23.181975 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5b1f5415-c393-495f-a056-382fb505532f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1241 microversion: 2.1 time: 0.189979 Jul 14 11:44:23.195077 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 10/20] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:22 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1241 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:23.596463 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-15a34dc1-afcd-4293-ba8e-9dbaae37cbe3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:23.601844 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-15a34dc1-afcd-4293-ba8e-9dbaae37cbe3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:23.623759 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-711fd401-5392-40cf-8849-4d8138ebe1d6 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:23.625030 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-711fd401-5392-40cf-8849-4d8138ebe1d6 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:23.660712 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-15a34dc1-afcd-4293-ba8e-9dbaae37cbe3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:23.662809 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-711fd401-5392-40cf-8849-4d8138ebe1d6 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:23.663460 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-711fd401-5392-40cf-8849-4d8138ebe1d6 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:23.663984 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-15a34dc1-afcd-4293-ba8e-9dbaae37cbe3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:23.665729 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-711fd401-5392-40cf-8849-4d8138ebe1d6 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:23.666139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-15a34dc1-afcd-4293-ba8e-9dbaae37cbe3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:23.666934 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-711fd401-5392-40cf-8849-4d8138ebe1d6 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:23.667739 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-15a34dc1-afcd-4293-ba8e-9dbaae37cbe3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:23.853280 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-15a34dc1-afcd-4293-ba8e-9dbaae37cbe3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:23.863465 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-15a34dc1-afcd-4293-ba8e-9dbaae37cbe3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:23.865196 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-15a34dc1-afcd-4293-ba8e-9dbaae37cbe3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:23.867918 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-15a34dc1-afcd-4293-ba8e-9dbaae37cbe3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1285 microversion: 2.20 time: 0.321769 Jul 14 11:44:23.873328 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 11/21] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:23 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1285 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:24.141489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-cdd21c00-63c7-4de4-88f4-cb32d310f9e4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:24.142403 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-cdd21c00-63c7-4de4-88f4-cb32d310f9e4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:24.156719 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cdd21c00-63c7-4de4-88f4-cb32d310f9e4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:24.157554 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cdd21c00-63c7-4de4-88f4-cb32d310f9e4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:24.158562 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cdd21c00-63c7-4de4-88f4-cb32d310f9e4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:24.159628 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cdd21c00-63c7-4de4-88f4-cb32d310f9e4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:24.260553 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-711fd401-5392-40cf-8849-4d8138ebe1d6 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:24.275682 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-711fd401-5392-40cf-8849-4d8138ebe1d6 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.659852 Jul 14 11:44:24.281305 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 11/22] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:23 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:24.303351 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-1e71113e-f8d9-4484-9631-687da0d92325 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:24.304433 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-1e71113e-f8d9-4484-9631-687da0d92325 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:24.340280 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1e71113e-f8d9-4484-9631-687da0d92325 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:24.343265 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1e71113e-f8d9-4484-9631-687da0d92325 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:24.348040 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1e71113e-f8d9-4484-9631-687da0d92325 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:24.348494 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1e71113e-f8d9-4484-9631-687da0d92325 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:24.410278 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-cdd21c00-63c7-4de4-88f4-cb32d310f9e4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:24.430739 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-cdd21c00-63c7-4de4-88f4-cb32d310f9e4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1289 microversion: 2.1 time: 0.294093 Jul 14 11:44:24.459157 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 12/23] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:24 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1289 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:44:24.508108 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-1e71113e-f8d9-4484-9631-687da0d92325 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:24.517377 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-1e71113e-f8d9-4484-9631-687da0d92325 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1245 microversion: 2.1 time: 0.234627 Jul 14 11:44:24.517967 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 12/24] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:24 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1245 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:24.890938 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3cd7e8e7-e1d8-4d55-b65a-e82eb2758d7c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:24.891710 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3cd7e8e7-e1d8-4d55-b65a-e82eb2758d7c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:24.907047 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3cd7e8e7-e1d8-4d55-b65a-e82eb2758d7c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:24.907497 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3cd7e8e7-e1d8-4d55-b65a-e82eb2758d7c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:24.908278 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3cd7e8e7-e1d8-4d55-b65a-e82eb2758d7c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:24.908826 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3cd7e8e7-e1d8-4d55-b65a-e82eb2758d7c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:25.051314 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3cd7e8e7-e1d8-4d55-b65a-e82eb2758d7c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:25.070434 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3cd7e8e7-e1d8-4d55-b65a-e82eb2758d7c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:25.071987 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3cd7e8e7-e1d8-4d55-b65a-e82eb2758d7c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:25.077318 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3cd7e8e7-e1d8-4d55-b65a-e82eb2758d7c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1285 microversion: 2.20 time: 0.192398 Jul 14 11:44:25.077902 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 13/25] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:24 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:25.297920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a75c7fc8-3870-41a2-ae69-59e3a5368f1b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:25.300476 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a75c7fc8-3870-41a2-ae69-59e3a5368f1b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:25.327654 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a75c7fc8-3870-41a2-ae69-59e3a5368f1b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:25.330775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a75c7fc8-3870-41a2-ae69-59e3a5368f1b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:25.332220 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a75c7fc8-3870-41a2-ae69-59e3a5368f1b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:25.333602 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a75c7fc8-3870-41a2-ae69-59e3a5368f1b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:25.464783 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-91d3bef1-ad28-44a8-804e-6ab378c86658 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:25.468353 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-91d3bef1-ad28-44a8-804e-6ab378c86658 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:25.480056 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-91d3bef1-ad28-44a8-804e-6ab378c86658 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:25.481958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-91d3bef1-ad28-44a8-804e-6ab378c86658 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:25.492985 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-91d3bef1-ad28-44a8-804e-6ab378c86658 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:25.497024 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-91d3bef1-ad28-44a8-804e-6ab378c86658 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:25.611860 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a75c7fc8-3870-41a2-ae69-59e3a5368f1b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:25.624605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-91d3bef1-ad28-44a8-804e-6ab378c86658 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:25.639424 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a75c7fc8-3870-41a2-ae69-59e3a5368f1b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.346046 Jul 14 11:44:25.642633 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 13/26] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:25 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:25.647639 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-91d3bef1-ad28-44a8-804e-6ab378c86658 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1289 microversion: 2.1 time: 0.186393 Jul 14 11:44:25.652097 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d865041d-377d-4034-95ce-64ac00d19984 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:25.653011 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 14/27] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:25 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1289 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:44:25.653935 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d865041d-377d-4034-95ce-64ac00d19984 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:25.660843 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d865041d-377d-4034-95ce-64ac00d19984 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:25.661664 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d865041d-377d-4034-95ce-64ac00d19984 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:25.662841 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d865041d-377d-4034-95ce-64ac00d19984 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:25.663696 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d865041d-377d-4034-95ce-64ac00d19984 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:25.829148 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d865041d-377d-4034-95ce-64ac00d19984 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:25.858307 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d865041d-377d-4034-95ce-64ac00d19984 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1245 microversion: 2.1 time: 0.211832 Jul 14 11:44:25.863817 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 14/28] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:25 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1245 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:26.095390 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-e8dd5674-b9ab-4f89-b801-29388eb093e2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:26.096832 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-e8dd5674-b9ab-4f89-b801-29388eb093e2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:26.103176 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e8dd5674-b9ab-4f89-b801-29388eb093e2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:26.103751 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e8dd5674-b9ab-4f89-b801-29388eb093e2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:26.105049 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e8dd5674-b9ab-4f89-b801-29388eb093e2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:26.105516 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e8dd5674-b9ab-4f89-b801-29388eb093e2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:26.206915 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e8dd5674-b9ab-4f89-b801-29388eb093e2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:26.221647 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e8dd5674-b9ab-4f89-b801-29388eb093e2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:26.221647 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e8dd5674-b9ab-4f89-b801-29388eb093e2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:26.221647 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-e8dd5674-b9ab-4f89-b801-29388eb093e2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1285 microversion: 2.20 time: 0.129092 Jul 14 11:44:26.221924 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 15/29] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:26 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:26.662198 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5844e5d9-2bc6-4cf0-ad47-885652b4a05a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:26.663597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5844e5d9-2bc6-4cf0-ad47-885652b4a05a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:26.669126 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-34e94e3b-ad13-4f89-86a3-b6b8f545d9e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:26.669903 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-34e94e3b-ad13-4f89-86a3-b6b8f545d9e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:26.678515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5844e5d9-2bc6-4cf0-ad47-885652b4a05a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:26.679779 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5844e5d9-2bc6-4cf0-ad47-885652b4a05a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:26.684991 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-34e94e3b-ad13-4f89-86a3-b6b8f545d9e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:26.685939 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-34e94e3b-ad13-4f89-86a3-b6b8f545d9e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:26.687972 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5844e5d9-2bc6-4cf0-ad47-885652b4a05a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:26.688505 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5844e5d9-2bc6-4cf0-ad47-885652b4a05a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:26.690071 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-34e94e3b-ad13-4f89-86a3-b6b8f545d9e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:26.692669 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-34e94e3b-ad13-4f89-86a3-b6b8f545d9e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:26.771630 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-34e94e3b-ad13-4f89-86a3-b6b8f545d9e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:26.785368 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-34e94e3b-ad13-4f89-86a3-b6b8f545d9e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1289 microversion: 2.1 time: 0.120878 Jul 14 11:44:26.787131 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 16/30] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:26 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1289 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:44:26.898943 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5ad85acb-98d3-436d-a895-02ed919b8b43 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:26.899511 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-5ad85acb-98d3-436d-a895-02ed919b8b43 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:26.919812 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5ad85acb-98d3-436d-a895-02ed919b8b43 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:26.920268 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5ad85acb-98d3-436d-a895-02ed919b8b43 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:26.921064 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5ad85acb-98d3-436d-a895-02ed919b8b43 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:26.921526 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5ad85acb-98d3-436d-a895-02ed919b8b43 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:26.954139 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5844e5d9-2bc6-4cf0-ad47-885652b4a05a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:26.965311 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5844e5d9-2bc6-4cf0-ad47-885652b4a05a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.307607 Jul 14 11:44:26.966732 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 15/31] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:26 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:27.111473 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-5ad85acb-98d3-436d-a895-02ed919b8b43 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:27.123011 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-5ad85acb-98d3-436d-a895-02ed919b8b43 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1245 microversion: 2.1 time: 0.240854 Jul 14 11:44:27.124137 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 17/32] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:26 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1245 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:27.243379 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-970218e6-2d87-4f20-8119-43070ae6bba4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:27.245871 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-970218e6-2d87-4f20-8119-43070ae6bba4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:27.254435 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-970218e6-2d87-4f20-8119-43070ae6bba4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:27.255113 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-970218e6-2d87-4f20-8119-43070ae6bba4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:27.256038 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-970218e6-2d87-4f20-8119-43070ae6bba4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:27.256625 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-970218e6-2d87-4f20-8119-43070ae6bba4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:27.402062 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-970218e6-2d87-4f20-8119-43070ae6bba4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:27.419411 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-970218e6-2d87-4f20-8119-43070ae6bba4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:27.421586 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-970218e6-2d87-4f20-8119-43070ae6bba4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:27.422878 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-970218e6-2d87-4f20-8119-43070ae6bba4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1285 microversion: 2.20 time: 0.187287 Jul 14 11:44:27.433698 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 16/33] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:27 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:27.811331 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-953bec7f-49e2-47db-bf65-34f211d031e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:27.815900 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-953bec7f-49e2-47db-bf65-34f211d031e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:27.842839 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-953bec7f-49e2-47db-bf65-34f211d031e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:27.848813 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-953bec7f-49e2-47db-bf65-34f211d031e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:27.848813 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-953bec7f-49e2-47db-bf65-34f211d031e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:27.857206 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-953bec7f-49e2-47db-bf65-34f211d031e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:27.983180 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-95252e09-da5d-4d4c-9c5d-19ea160b42a4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:27.984827 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-95252e09-da5d-4d4c-9c5d-19ea160b42a4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:27.999772 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-95252e09-da5d-4d4c-9c5d-19ea160b42a4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:28.000233 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-95252e09-da5d-4d4c-9c5d-19ea160b42a4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:28.001028 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-95252e09-da5d-4d4c-9c5d-19ea160b42a4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:28.001487 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-95252e09-da5d-4d4c-9c5d-19ea160b42a4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:28.006725 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-953bec7f-49e2-47db-bf65-34f211d031e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:28.019669 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-953bec7f-49e2-47db-bf65-34f211d031e2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1289 microversion: 2.1 time: 0.220040 Jul 14 11:44:28.020500 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 18/34] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:27 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1289 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:28.140581 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f930f9a9-fc1c-4387-bc7b-8a7adb130ff5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:28.141377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f930f9a9-fc1c-4387-bc7b-8a7adb130ff5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:28.153231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f930f9a9-fc1c-4387-bc7b-8a7adb130ff5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:28.153683 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f930f9a9-fc1c-4387-bc7b-8a7adb130ff5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:28.154469 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f930f9a9-fc1c-4387-bc7b-8a7adb130ff5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:28.154908 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f930f9a9-fc1c-4387-bc7b-8a7adb130ff5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:28.288586 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f930f9a9-fc1c-4387-bc7b-8a7adb130ff5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:28.296867 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f930f9a9-fc1c-4387-bc7b-8a7adb130ff5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1245 microversion: 2.1 time: 0.160144 Jul 14 11:44:28.298047 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 19/35] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:28 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1245 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:28.354452 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-95252e09-da5d-4d4c-9c5d-19ea160b42a4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:28.363590 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-95252e09-da5d-4d4c-9c5d-19ea160b42a4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.384678 Jul 14 11:44:28.364914 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 17/36] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:27 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:28.441786 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9886f485-429b-43a8-96f6-4f6676b1431f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:28.448957 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9886f485-429b-43a8-96f6-4f6676b1431f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:28.458912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9886f485-429b-43a8-96f6-4f6676b1431f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:28.459802 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9886f485-429b-43a8-96f6-4f6676b1431f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:28.460593 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9886f485-429b-43a8-96f6-4f6676b1431f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:28.461029 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9886f485-429b-43a8-96f6-4f6676b1431f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:28.544311 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9886f485-429b-43a8-96f6-4f6676b1431f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:28.563527 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9886f485-429b-43a8-96f6-4f6676b1431f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:28.566031 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9886f485-429b-43a8-96f6-4f6676b1431f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:28.568936 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9886f485-429b-43a8-96f6-4f6676b1431f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1285 microversion: 2.20 time: 0.130330 Jul 14 11:44:28.577745 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 20/37] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:28 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:29.043421 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b9dcfb2f-d158-45bf-a7bb-2825b1cb3a4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:29.044048 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b9dcfb2f-d158-45bf-a7bb-2825b1cb3a4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:29.051487 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b9dcfb2f-d158-45bf-a7bb-2825b1cb3a4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:29.051993 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b9dcfb2f-d158-45bf-a7bb-2825b1cb3a4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:29.057598 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b9dcfb2f-d158-45bf-a7bb-2825b1cb3a4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:29.058196 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b9dcfb2f-d158-45bf-a7bb-2825b1cb3a4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:29.167987 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b9dcfb2f-d158-45bf-a7bb-2825b1cb3a4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:29.177611 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b9dcfb2f-d158-45bf-a7bb-2825b1cb3a4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1289 microversion: 2.1 time: 0.138785 Jul 14 11:44:29.178567 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 18/38] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:29 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1289 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:29.314294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b232122c-142c-46c9-bdb4-d3913522380e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:29.315102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b232122c-142c-46c9-bdb4-d3913522380e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:29.322795 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b232122c-142c-46c9-bdb4-d3913522380e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:29.323243 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b232122c-142c-46c9-bdb4-d3913522380e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:29.324009 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b232122c-142c-46c9-bdb4-d3913522380e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:29.326400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b232122c-142c-46c9-bdb4-d3913522380e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:29.381145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-711c6a15-5e31-42f5-945a-c15b88f0d1d8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:29.381999 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-711c6a15-5e31-42f5-945a-c15b88f0d1d8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:29.396475 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-711c6a15-5e31-42f5-945a-c15b88f0d1d8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:29.397314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-711c6a15-5e31-42f5-945a-c15b88f0d1d8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:29.398331 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-711c6a15-5e31-42f5-945a-c15b88f0d1d8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:29.399239 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-711c6a15-5e31-42f5-945a-c15b88f0d1d8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:29.455120 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b232122c-142c-46c9-bdb4-d3913522380e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:29.490295 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b232122c-142c-46c9-bdb4-d3913522380e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1245 microversion: 2.1 time: 0.178994 Jul 14 11:44:29.492020 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 21/39] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:29 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1245 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:29.594028 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3fdc0ec4-eca9-4a0f-b87b-58b967f1b88d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:29.595109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3fdc0ec4-eca9-4a0f-b87b-58b967f1b88d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:29.602315 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3fdc0ec4-eca9-4a0f-b87b-58b967f1b88d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:29.602778 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3fdc0ec4-eca9-4a0f-b87b-58b967f1b88d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:29.604158 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3fdc0ec4-eca9-4a0f-b87b-58b967f1b88d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:29.604699 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3fdc0ec4-eca9-4a0f-b87b-58b967f1b88d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:29.605686 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-711c6a15-5e31-42f5-945a-c15b88f0d1d8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:29.615058 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-711c6a15-5e31-42f5-945a-c15b88f0d1d8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.238053 Jul 14 11:44:29.619665 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 19/40] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:29 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:44:29.672846 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3fdc0ec4-eca9-4a0f-b87b-58b967f1b88d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:29.683689 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3fdc0ec4-eca9-4a0f-b87b-58b967f1b88d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:29.685441 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3fdc0ec4-eca9-4a0f-b87b-58b967f1b88d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:29.686691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3fdc0ec4-eca9-4a0f-b87b-58b967f1b88d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1285 microversion: 2.20 time: 0.096582 Jul 14 11:44:29.687836 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 22/41] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:29 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:44:30.195994 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e259b2a0-22f0-4ca5-800b-4a103bcb3d27 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:30.197625 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e259b2a0-22f0-4ca5-800b-4a103bcb3d27 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:30.199858 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=6 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:30.205514 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e259b2a0-22f0-4ca5-800b-4a103bcb3d27 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:30.206210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e259b2a0-22f0-4ca5-800b-4a103bcb3d27 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:30.207326 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e259b2a0-22f0-4ca5-800b-4a103bcb3d27 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:30.207785 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e259b2a0-22f0-4ca5-800b-4a103bcb3d27 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:30.318809 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e259b2a0-22f0-4ca5-800b-4a103bcb3d27 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:30.325728 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e259b2a0-22f0-4ca5-800b-4a103bcb3d27 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1289 microversion: 2.1 time: 0.133633 Jul 14 11:44:30.327056 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 20/42] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:30 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1289 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:44:30.512102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-832ad9e8-187b-4bbf-9b83-633184fc01b6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:30.512102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-832ad9e8-187b-4bbf-9b83-633184fc01b6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:30.520078 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:30.522029 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-832ad9e8-187b-4bbf-9b83-633184fc01b6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:30.522478 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-832ad9e8-187b-4bbf-9b83-633184fc01b6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:30.523263 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-832ad9e8-187b-4bbf-9b83-633184fc01b6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:30.523964 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-832ad9e8-187b-4bbf-9b83-633184fc01b6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:30.612005 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-832ad9e8-187b-4bbf-9b83-633184fc01b6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:30.619886 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-832ad9e8-187b-4bbf-9b83-633184fc01b6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1245 microversion: 2.1 time: 0.113015 Jul 14 11:44:30.620454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 23/43] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:30 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1245 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:30.637142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-89ab5e49-ae2a-49f7-8c5f-0a5b21be9763 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:30.637918 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-89ab5e49-ae2a-49f7-8c5f-0a5b21be9763 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:30.644581 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-89ab5e49-ae2a-49f7-8c5f-0a5b21be9763 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:30.645466 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-89ab5e49-ae2a-49f7-8c5f-0a5b21be9763 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:30.646696 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-89ab5e49-ae2a-49f7-8c5f-0a5b21be9763 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:30.647345 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-89ab5e49-ae2a-49f7-8c5f-0a5b21be9763 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:30.707181 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-35c50cfd-e4c6-4266-b586-59985800d3c1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:30.708124 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-35c50cfd-e4c6-4266-b586-59985800d3c1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:30.735826 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-35c50cfd-e4c6-4266-b586-59985800d3c1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:30.736568 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-35c50cfd-e4c6-4266-b586-59985800d3c1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:30.737792 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-35c50cfd-e4c6-4266-b586-59985800d3c1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:30.740892 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-35c50cfd-e4c6-4266-b586-59985800d3c1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:30.875491 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-35c50cfd-e4c6-4266-b586-59985800d3c1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:30.886217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-35c50cfd-e4c6-4266-b586-59985800d3c1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:30.890486 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-35c50cfd-e4c6-4266-b586-59985800d3c1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:30.890746 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-89ab5e49-ae2a-49f7-8c5f-0a5b21be9763 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:30.892087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-35c50cfd-e4c6-4266-b586-59985800d3c1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1285 microversion: 2.20 time: 0.189386 Jul 14 11:44:30.892645 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 24/44] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:30 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:44:30.911294 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-89ab5e49-ae2a-49f7-8c5f-0a5b21be9763 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.272699 Jul 14 11:44:30.912417 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 21/45] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:30 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:31.343591 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-e152c668-71a7-47d7-96f6-0ffb33442c1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:31.344473 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-e152c668-71a7-47d7-96f6-0ffb33442c1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:31.361718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e152c668-71a7-47d7-96f6-0ffb33442c1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:31.362220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e152c668-71a7-47d7-96f6-0ffb33442c1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:31.363704 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e152c668-71a7-47d7-96f6-0ffb33442c1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:31.364162 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e152c668-71a7-47d7-96f6-0ffb33442c1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:31.369646 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=100 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:31.470087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e152c668-71a7-47d7-96f6-0ffb33442c1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:31.477752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-e152c668-71a7-47d7-96f6-0ffb33442c1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1297 microversion: 2.1 time: 0.138271 Jul 14 11:44:31.479558 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 25/46] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:31 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1297 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:31.640201 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-0ba0ff8d-bacd-4ca7-9510-ec4f846e0be5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:31.640830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-0ba0ff8d-bacd-4ca7-9510-ec4f846e0be5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:31.655723 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0ba0ff8d-bacd-4ca7-9510-ec4f846e0be5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:31.656197 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0ba0ff8d-bacd-4ca7-9510-ec4f846e0be5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:31.657004 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0ba0ff8d-bacd-4ca7-9510-ec4f846e0be5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:31.659838 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0ba0ff8d-bacd-4ca7-9510-ec4f846e0be5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:31.841100 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-0ba0ff8d-bacd-4ca7-9510-ec4f846e0be5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:31.849721 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-0ba0ff8d-bacd-4ca7-9510-ec4f846e0be5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1237 microversion: 2.1 time: 0.213642 Jul 14 11:44:31.860969 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 22/47] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:31 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1237 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:31.922185 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-fd7f654e-dd5b-415d-b90d-08048f5e7f8e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:31.923380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-fd7f654e-dd5b-415d-b90d-08048f5e7f8e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:31.929535 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-59fee688-d0ef-4938-bf70-6d24e528b198 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:31.930814 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-59fee688-d0ef-4938-bf70-6d24e528b198 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:31.941064 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:31.943756 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:31.948296 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-59fee688-d0ef-4938-bf70-6d24e528b198 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:31.950389 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fd7f654e-dd5b-415d-b90d-08048f5e7f8e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:31.951090 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-59fee688-d0ef-4938-bf70-6d24e528b198 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:31.952136 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-59fee688-d0ef-4938-bf70-6d24e528b198 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:31.952574 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-59fee688-d0ef-4938-bf70-6d24e528b198 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:31.955504 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fd7f654e-dd5b-415d-b90d-08048f5e7f8e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:31.956720 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fd7f654e-dd5b-415d-b90d-08048f5e7f8e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:31.957458 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fd7f654e-dd5b-415d-b90d-08048f5e7f8e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:32.018376 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=100 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:32.169418 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-fd7f654e-dd5b-415d-b90d-08048f5e7f8e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:32.180104 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-fd7f654e-dd5b-415d-b90d-08048f5e7f8e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:32.186049 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-fd7f654e-dd5b-415d-b90d-08048f5e7f8e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:32.191306 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-fd7f654e-dd5b-415d-b90d-08048f5e7f8e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1333 microversion: 2.20 time: 0.276781 Jul 14 11:44:32.202187 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 26/48] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:31 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1333 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:32.462061 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-59fee688-d0ef-4938-bf70-6d24e528b198 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:32.470451 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-59fee688-d0ef-4938-bf70-6d24e528b198 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.545159 Jul 14 11:44:32.471483 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 23/49] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:31 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:44:32.510387 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c73a5f0b-7b35-43ae-8a4b-de360d0fa566 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:32.510387 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c73a5f0b-7b35-43ae-8a4b-de360d0fa566 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:32.510695 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c73a5f0b-7b35-43ae-8a4b-de360d0fa566 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:32.511030 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c73a5f0b-7b35-43ae-8a4b-de360d0fa566 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:32.511857 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c73a5f0b-7b35-43ae-8a4b-de360d0fa566 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:32.512449 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c73a5f0b-7b35-43ae-8a4b-de360d0fa566 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:32.533321 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=26 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:32.584699 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c73a5f0b-7b35-43ae-8a4b-de360d0fa566 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:32.593385 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c73a5f0b-7b35-43ae-8a4b-de360d0fa566 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1295 microversion: 2.1 time: 0.101936 Jul 14 11:44:32.594559 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 27/50] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:32 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1295 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:32.873970 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e8605c6b-fd10-4ce5-b939-22cca86c34cb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:32.874726 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e8605c6b-fd10-4ce5-b939-22cca86c34cb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:32.887484 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e8605c6b-fd10-4ce5-b939-22cca86c34cb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:32.888162 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e8605c6b-fd10-4ce5-b939-22cca86c34cb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:32.889209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e8605c6b-fd10-4ce5-b939-22cca86c34cb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:32.889959 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e8605c6b-fd10-4ce5-b939-22cca86c34cb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:33.038676 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e8605c6b-fd10-4ce5-b939-22cca86c34cb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:33.050108 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e8605c6b-fd10-4ce5-b939-22cca86c34cb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1301 microversion: 2.1 time: 0.185371 Jul 14 11:44:33.054418 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 24/51] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:32 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1301 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:33.211721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-85514d80-f3ca-4e2f-b46b-3a975c4ce86a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:33.214272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-85514d80-f3ca-4e2f-b46b-3a975c4ce86a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:33.233832 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85514d80-f3ca-4e2f-b46b-3a975c4ce86a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:33.234469 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85514d80-f3ca-4e2f-b46b-3a975c4ce86a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:33.240558 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85514d80-f3ca-4e2f-b46b-3a975c4ce86a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:33.241525 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85514d80-f3ca-4e2f-b46b-3a975c4ce86a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:33.471717 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-85514d80-f3ca-4e2f-b46b-3a975c4ce86a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:33.481117 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-85514d80-f3ca-4e2f-b46b-3a975c4ce86a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:33.483040 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-85514d80-f3ca-4e2f-b46b-3a975c4ce86a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:33.484264 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-85514d80-f3ca-4e2f-b46b-3a975c4ce86a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1341 microversion: 2.20 time: 0.277462 Jul 14 11:44:33.495239 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 28/52] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:33 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1341 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:33.495369 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=26 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:33.500228 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-133f2971-100f-4375-91c2-2e73b5590dc2 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:33.501266 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-133f2971-100f-4375-91c2-2e73b5590dc2 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:33.511916 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-133f2971-100f-4375-91c2-2e73b5590dc2 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:33.511916 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-133f2971-100f-4375-91c2-2e73b5590dc2 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:33.511916 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-133f2971-100f-4375-91c2-2e73b5590dc2 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:33.511916 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-133f2971-100f-4375-91c2-2e73b5590dc2 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:33.611058 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-33634725-307f-4503-93c9-1633d8723199 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:33.611684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-33634725-307f-4503-93c9-1633d8723199 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:33.622466 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-33634725-307f-4503-93c9-1633d8723199 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:33.623077 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-33634725-307f-4503-93c9-1633d8723199 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:33.623921 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-33634725-307f-4503-93c9-1633d8723199 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:33.624439 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-33634725-307f-4503-93c9-1633d8723199 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:33.695967 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-33634725-307f-4503-93c9-1633d8723199 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:33.704297 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-33634725-307f-4503-93c9-1633d8723199 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1295 microversion: 2.1 time: 0.097166 Jul 14 11:44:33.704948 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 29/53] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:33 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:33.787332 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-133f2971-100f-4375-91c2-2e73b5590dc2 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:33.806441 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-133f2971-100f-4375-91c2-2e73b5590dc2 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.320063 Jul 14 11:44:33.808238 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 25/54] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:33 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:34.070713 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b142760f-cce0-4821-b137-3eafb9161c31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:34.071393 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b142760f-cce0-4821-b137-3eafb9161c31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:34.084387 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b142760f-cce0-4821-b137-3eafb9161c31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:34.084888 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b142760f-cce0-4821-b137-3eafb9161c31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:34.088942 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b142760f-cce0-4821-b137-3eafb9161c31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:34.089506 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b142760f-cce0-4821-b137-3eafb9161c31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:34.205968 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b142760f-cce0-4821-b137-3eafb9161c31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:34.217187 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b142760f-cce0-4821-b137-3eafb9161c31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1299 microversion: 2.1 time: 0.150117 Jul 14 11:44:34.218222 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 30/55] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:34 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1299 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:34.508032 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d5e78903-4bab-4758-a0ec-88764f79750c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:34.522508 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d5e78903-4bab-4758-a0ec-88764f79750c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:34.524032 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-f8d8669b-43da-494d-b919-8322169d7748 req-6ac38119-dcbe-4e76-9327-e3186bb2b677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84831c0d-d0dd-43e7-ae1c-231d7fb307b2", "tag": "29fc8120-97c5-4a52-86fc-ca5ec90b971c"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:34.562965 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5e78903-4bab-4758-a0ec-88764f79750c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:34.569611 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5e78903-4bab-4758-a0ec-88764f79750c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:34.578767 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5e78903-4bab-4758-a0ec-88764f79750c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:34.578767 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5e78903-4bab-4758-a0ec-88764f79750c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:34.590385 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-f8d8669b-43da-494d-b919-8322169d7748 req-6ac38119-dcbe-4e76-9327-e3186bb2b677 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:34.590888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-f8d8669b-43da-494d-b919-8322169d7748 req-6ac38119-dcbe-4e76-9327-e3186bb2b677 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:34.632169 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-f8d8669b-43da-494d-b919-8322169d7748 req-6ac38119-dcbe-4e76-9327-e3186bb2b677 service nova] Creating event network-changed:29fc8120-97c5-4a52-86fc-ca5ec90b971c for instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 on hv-cinder-84980 Jul 14 11:44:34.633533 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-f8d8669b-43da-494d-b919-8322169d7748 req-6ac38119-dcbe-4e76-9327-e3186bb2b677 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124946) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 11:44:34.635603 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-068154ac-c9f2-4adf-b928-ae06dab582c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:34.636389 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-068154ac-c9f2-4adf-b928-ae06dab582c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:34.637454 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-068154ac-c9f2-4adf-b928-ae06dab582c4 None None] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:34.637908 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-068154ac-c9f2-4adf-b928-ae06dab582c4 None None] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:34.647935 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.compute.rpcapi [None req-068154ac-c9f2-4adf-b928-ae06dab582c4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 11:44:34.649312 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-068154ac-c9f2-4adf-b928-ae06dab582c4 None None] Releasing lock "compute-rpcapi-router" {{(pid=124946) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 11:44:34.684077 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d5e78903-4bab-4758-a0ec-88764f79750c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:34.689584 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-068154ac-c9f2-4adf-b928-ae06dab582c4 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.326910 Jul 14 11:44:34.690509 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 26/56] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:44:34.716373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d5e78903-4bab-4758-a0ec-88764f79750c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:34.718421 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d5e78903-4bab-4758-a0ec-88764f79750c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:34.722137 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e92eeadc-c71d-4c9a-96ba-d9addf4f92ae tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:34.724738 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e92eeadc-c71d-4c9a-96ba-d9addf4f92ae tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:34.726539 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d5e78903-4bab-4758-a0ec-88764f79750c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1339 microversion: 2.20 time: 0.223817 Jul 14 11:44:34.730880 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 31/57] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:34 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1339 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:34.746375 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e92eeadc-c71d-4c9a-96ba-d9addf4f92ae tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:34.747088 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e92eeadc-c71d-4c9a-96ba-d9addf4f92ae tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:34.748117 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e92eeadc-c71d-4c9a-96ba-d9addf4f92ae tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:34.748564 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e92eeadc-c71d-4c9a-96ba-d9addf4f92ae tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:34.827498 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ee604f48-68d8-4b2b-8455-2333f142f3c4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:34.833058 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ee604f48-68d8-4b2b-8455-2333f142f3c4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:34.840885 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ee604f48-68d8-4b2b-8455-2333f142f3c4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:34.841358 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ee604f48-68d8-4b2b-8455-2333f142f3c4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:34.842356 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ee604f48-68d8-4b2b-8455-2333f142f3c4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:34.842966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ee604f48-68d8-4b2b-8455-2333f142f3c4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:35.231803 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e92eeadc-c71d-4c9a-96ba-d9addf4f92ae tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:35.240429 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e92eeadc-c71d-4c9a-96ba-d9addf4f92ae tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1363 microversion: 2.1 time: 0.522784 Jul 14 11:44:35.241298 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 27/58] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:34 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1363 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:44:35.247083 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6470d652-0f1e-456d-bcef-90d512ee9465 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:35.249382 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6470d652-0f1e-456d-bcef-90d512ee9465 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:35.257575 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ee604f48-68d8-4b2b-8455-2333f142f3c4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:35.259064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6470d652-0f1e-456d-bcef-90d512ee9465 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:35.260307 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6470d652-0f1e-456d-bcef-90d512ee9465 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:35.261294 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6470d652-0f1e-456d-bcef-90d512ee9465 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:35.261878 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6470d652-0f1e-456d-bcef-90d512ee9465 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:35.268077 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ee604f48-68d8-4b2b-8455-2333f142f3c4 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.444509 Jul 14 11:44:35.269041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 32/59] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:34 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:35.506741 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6470d652-0f1e-456d-bcef-90d512ee9465 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:35.515802 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6470d652-0f1e-456d-bcef-90d512ee9465 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1299 microversion: 2.1 time: 0.273185 Jul 14 11:44:35.516484 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 28/60] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:35 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1299 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:35.758234 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3248788c-2062-4d11-ac2d-977199c6637a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:35.759167 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3248788c-2062-4d11-ac2d-977199c6637a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:35.778550 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3248788c-2062-4d11-ac2d-977199c6637a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:35.779002 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3248788c-2062-4d11-ac2d-977199c6637a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:35.779789 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3248788c-2062-4d11-ac2d-977199c6637a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:35.780221 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3248788c-2062-4d11-ac2d-977199c6637a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:36.146528 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3248788c-2062-4d11-ac2d-977199c6637a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:36.171706 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3248788c-2062-4d11-ac2d-977199c6637a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:36.179362 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3248788c-2062-4d11-ac2d-977199c6637a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:36.186633 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3248788c-2062-4d11-ac2d-977199c6637a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1407 microversion: 2.20 time: 0.439751 Jul 14 11:44:36.189617 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 33/61] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:35 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:36.260657 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-aeb0293f-6a57-4169-a8f9-d3aa3eb92651 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:36.260657 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-aeb0293f-6a57-4169-a8f9-d3aa3eb92651 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:36.270902 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-aeb0293f-6a57-4169-a8f9-d3aa3eb92651 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:36.271641 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-aeb0293f-6a57-4169-a8f9-d3aa3eb92651 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:36.272778 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-aeb0293f-6a57-4169-a8f9-d3aa3eb92651 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:36.273965 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-aeb0293f-6a57-4169-a8f9-d3aa3eb92651 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:36.286158 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ce98ce26-e1dd-4dd2-93d3-99cee394f41c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:36.286769 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ce98ce26-e1dd-4dd2-93d3-99cee394f41c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:36.296563 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ce98ce26-e1dd-4dd2-93d3-99cee394f41c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:36.297028 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ce98ce26-e1dd-4dd2-93d3-99cee394f41c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:36.297851 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ce98ce26-e1dd-4dd2-93d3-99cee394f41c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:36.298292 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ce98ce26-e1dd-4dd2-93d3-99cee394f41c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:36.691337 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ce98ce26-e1dd-4dd2-93d3-99cee394f41c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:36.701200 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ce98ce26-e1dd-4dd2-93d3-99cee394f41c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.418660 Jul 14 11:44:36.704815 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 34/62] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:36 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:36.714101 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-be14c148-c42e-4610-88eb-de51e53d45d6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:36.714847 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-be14c148-c42e-4610-88eb-de51e53d45d6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:36.721030 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-be14c148-c42e-4610-88eb-de51e53d45d6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:36.721731 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-be14c148-c42e-4610-88eb-de51e53d45d6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:36.722760 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-be14c148-c42e-4610-88eb-de51e53d45d6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:36.723309 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-be14c148-c42e-4610-88eb-de51e53d45d6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:36.766766 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-aeb0293f-6a57-4169-a8f9-d3aa3eb92651 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:36.777414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-aeb0293f-6a57-4169-a8f9-d3aa3eb92651 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1363 microversion: 2.1 time: 0.522892 Jul 14 11:44:36.778344 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 29/63] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:36 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1363 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:37.109443 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-3e6d8838-08c6-4dda-9a0a-fa236e4496d3 req-3a0462f4-c5ca-4ceb-bc3b-403835fd0323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36228e4a-c9d6-4e57-81fe-e8a49d221573", "tag": "a691a194-3f01-478d-96f7-2e83d0eb6f7d"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:37.144425 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-3e6d8838-08c6-4dda-9a0a-fa236e4496d3 req-3a0462f4-c5ca-4ceb-bc3b-403835fd0323 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:37.152794 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-3e6d8838-08c6-4dda-9a0a-fa236e4496d3 req-3a0462f4-c5ca-4ceb-bc3b-403835fd0323 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:37.187991 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-3e6d8838-08c6-4dda-9a0a-fa236e4496d3 req-3a0462f4-c5ca-4ceb-bc3b-403835fd0323 service nova] Creating event network-changed:a691a194-3f01-478d-96f7-2e83d0eb6f7d for instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 on hv-cinder-84980 Jul 14 11:44:37.267923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-3e6d8838-08c6-4dda-9a0a-fa236e4496d3 req-3a0462f4-c5ca-4ceb-bc3b-403835fd0323 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157797 Jul 14 11:44:37.276555 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 30/64] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:44:37.299235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-121679a3-20b9-47a2-a6fb-5a3ec60e8454 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:37.317978 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-121679a3-20b9-47a2-a6fb-5a3ec60e8454 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:37.340084 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-121679a3-20b9-47a2-a6fb-5a3ec60e8454 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:37.348324 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-121679a3-20b9-47a2-a6fb-5a3ec60e8454 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:37.352043 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-121679a3-20b9-47a2-a6fb-5a3ec60e8454 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:37.353295 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-121679a3-20b9-47a2-a6fb-5a3ec60e8454 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:37.418148 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-be14c148-c42e-4610-88eb-de51e53d45d6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:37.428073 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-be14c148-c42e-4610-88eb-de51e53d45d6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1367 microversion: 2.1 time: 0.722055 Jul 14 11:44:37.428652 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 35/65] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:36 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1367 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:37.556579 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-d41e4a2f-a0b9-4b9c-abbe-c30a19a5ec71 req-f4bd5251-5d2b-4282-9a8f-36d45e063bfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f44195-49ec-496b-937e-eb9722a215c0", "tag": "cf1c50ae-e6c8-42f3-9333-a8eaf141bcd0"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:37.581703 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-d41e4a2f-a0b9-4b9c-abbe-c30a19a5ec71 req-f4bd5251-5d2b-4282-9a8f-36d45e063bfd service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:37.582144 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-d41e4a2f-a0b9-4b9c-abbe-c30a19a5ec71 req-f4bd5251-5d2b-4282-9a8f-36d45e063bfd service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:37.624793 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-d41e4a2f-a0b9-4b9c-abbe-c30a19a5ec71 req-f4bd5251-5d2b-4282-9a8f-36d45e063bfd service nova] Creating event network-changed:cf1c50ae-e6c8-42f3-9333-a8eaf141bcd0 for instance 03f44195-49ec-496b-937e-eb9722a215c0 on hv-cinder-84980 Jul 14 11:44:37.625391 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-d41e4a2f-a0b9-4b9c-abbe-c30a19a5ec71 req-f4bd5251-5d2b-4282-9a8f-36d45e063bfd service nova] Acquired lock "compute-rpcapi-router" {{(pid=124947) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 11:44:37.626558 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4cc94922-1031-486a-80fa-6433ee3d67a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:37.626998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4cc94922-1031-486a-80fa-6433ee3d67a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:37.627869 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4cc94922-1031-486a-80fa-6433ee3d67a9 None None] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:37.628441 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4cc94922-1031-486a-80fa-6433ee3d67a9 None None] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:37.657837 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.compute.rpcapi [None req-4cc94922-1031-486a-80fa-6433ee3d67a9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 11:44:37.659028 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4cc94922-1031-486a-80fa-6433ee3d67a9 None None] Releasing lock "compute-rpcapi-router" {{(pid=124947) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 11:44:37.691653 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-4cc94922-1031-486a-80fa-6433ee3d67a9 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259138 Jul 14 11:44:37.692781 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 36/66] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:44:37.719783 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5f74af83-f111-40a3-ba7e-f5a10321a0af tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:37.720926 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-5f74af83-f111-40a3-ba7e-f5a10321a0af tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:37.731446 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5f74af83-f111-40a3-ba7e-f5a10321a0af tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:37.732108 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5f74af83-f111-40a3-ba7e-f5a10321a0af tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:37.733212 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5f74af83-f111-40a3-ba7e-f5a10321a0af tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:37.734060 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5f74af83-f111-40a3-ba7e-f5a10321a0af tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:38.088920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-5f74af83-f111-40a3-ba7e-f5a10321a0af tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:38.097756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-5f74af83-f111-40a3-ba7e-f5a10321a0af tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.381838 Jul 14 11:44:38.122565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 37/67] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:37 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:44:38.136446 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b700c79e-c1f2-4585-9bbc-2262993f39ee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:38.137525 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b700c79e-c1f2-4585-9bbc-2262993f39ee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:38.147076 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b700c79e-c1f2-4585-9bbc-2262993f39ee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:38.150723 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b700c79e-c1f2-4585-9bbc-2262993f39ee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:38.151973 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b700c79e-c1f2-4585-9bbc-2262993f39ee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:38.152740 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b700c79e-c1f2-4585-9bbc-2262993f39ee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:38.480647 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-121679a3-20b9-47a2-a6fb-5a3ec60e8454 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:38.486801 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b700c79e-c1f2-4585-9bbc-2262993f39ee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:38.496069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b700c79e-c1f2-4585-9bbc-2262993f39ee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1363 microversion: 2.1 time: 0.372100 Jul 14 11:44:38.498435 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 38/68] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:38 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1363 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:38.506151 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8b303c45-d98b-4ae9-b86b-f51afe08dc46 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:38.510464 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-8b303c45-d98b-4ae9-b86b-f51afe08dc46 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:38.514732 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8b303c45-d98b-4ae9-b86b-f51afe08dc46 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:38.515408 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8b303c45-d98b-4ae9-b86b-f51afe08dc46 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:38.516692 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8b303c45-d98b-4ae9-b86b-f51afe08dc46 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:38.517491 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-121679a3-20b9-47a2-a6fb-5a3ec60e8454 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:38.518600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8b303c45-d98b-4ae9-b86b-f51afe08dc46 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:38.525638 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-121679a3-20b9-47a2-a6fb-5a3ec60e8454 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:38.527118 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-121679a3-20b9-47a2-a6fb-5a3ec60e8454 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1407 microversion: 2.20 time: 1.249325 Jul 14 11:44:38.530559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 31/69] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:37 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1407 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:38.745052 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-8b303c45-d98b-4ae9-b86b-f51afe08dc46 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:38.756922 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-8b303c45-d98b-4ae9-b86b-f51afe08dc46 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1367 microversion: 2.1 time: 0.255482 Jul 14 11:44:38.766219 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 39/70] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:38 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:39.139179 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-35762cbe-068a-435f-ab6c-1c9ea6889a52 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:39.139714 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-35762cbe-068a-435f-ab6c-1c9ea6889a52 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:39.145724 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-35762cbe-068a-435f-ab6c-1c9ea6889a52 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:39.146241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-35762cbe-068a-435f-ab6c-1c9ea6889a52 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:39.146941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-35762cbe-068a-435f-ab6c-1c9ea6889a52 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:39.147527 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-35762cbe-068a-435f-ab6c-1c9ea6889a52 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:39.306956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-aaec7584-4acd-4941-9e05-e1fdf0c0785e req-2bb924e8-34ee-4b9f-97f3-6020708511a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc1d8c0-48e2-49bd-8807-bb041db6a9df", "tag": "8ec85559-8aa6-4f19-b912-73c9a2d4d487"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:39.320438 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-aaec7584-4acd-4941-9e05-e1fdf0c0785e req-2bb924e8-34ee-4b9f-97f3-6020708511a4 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:39.320773 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-aaec7584-4acd-4941-9e05-e1fdf0c0785e req-2bb924e8-34ee-4b9f-97f3-6020708511a4 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:39.367688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-aaec7584-4acd-4941-9e05-e1fdf0c0785e req-2bb924e8-34ee-4b9f-97f3-6020708511a4 service nova] Creating event network-changed:8ec85559-8aa6-4f19-b912-73c9a2d4d487 for instance edc1d8c0-48e2-49bd-8807-bb041db6a9df on hv-cinder-84980 Jul 14 11:44:39.382811 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-aaec7584-4acd-4941-9e05-e1fdf0c0785e req-2bb924e8-34ee-4b9f-97f3-6020708511a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079348 Jul 14 11:44:39.383691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 40/71] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:44:39.514421 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-35762cbe-068a-435f-ab6c-1c9ea6889a52 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:39.518601 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2ca8a596-5d62-4a0d-9699-df5472a8b188 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:39.520997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2ca8a596-5d62-4a0d-9699-df5472a8b188 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:39.534528 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-35762cbe-068a-435f-ab6c-1c9ea6889a52 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.399663 Jul 14 11:44:39.547062 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ca8a596-5d62-4a0d-9699-df5472a8b188 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:39.549138 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 32/72] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:39 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:39.550744 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ca8a596-5d62-4a0d-9699-df5472a8b188 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:39.553338 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ca8a596-5d62-4a0d-9699-df5472a8b188 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:39.555076 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ca8a596-5d62-4a0d-9699-df5472a8b188 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:39.564436 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6f44cf7c-982e-4596-86ce-9f738813d5ac tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:39.565550 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6f44cf7c-982e-4596-86ce-9f738813d5ac tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:39.575263 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6f44cf7c-982e-4596-86ce-9f738813d5ac tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:39.580611 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6f44cf7c-982e-4596-86ce-9f738813d5ac tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:39.582007 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6f44cf7c-982e-4596-86ce-9f738813d5ac tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:39.582759 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6f44cf7c-982e-4596-86ce-9f738813d5ac tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:40.007944 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6f44cf7c-982e-4596-86ce-9f738813d5ac tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:40.012177 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2ca8a596-5d62-4a0d-9699-df5472a8b188 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:40.019111 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6f44cf7c-982e-4596-86ce-9f738813d5ac tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:40.020563 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2ca8a596-5d62-4a0d-9699-df5472a8b188 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1363 microversion: 2.1 time: 0.507816 Jul 14 11:44:40.021138 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 41/73] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:39 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1363 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:44:40.033704 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6f44cf7c-982e-4596-86ce-9f738813d5ac tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:40.033704 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6f44cf7c-982e-4596-86ce-9f738813d5ac tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1407 microversion: 2.20 time: 0.482995 Jul 14 11:44:40.034312 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 33/74] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:39 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:40.040186 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5a72e0bc-63a2-4324-8b42-35eba5fa02c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:40.041933 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5a72e0bc-63a2-4324-8b42-35eba5fa02c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:40.055595 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5a72e0bc-63a2-4324-8b42-35eba5fa02c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:40.056047 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5a72e0bc-63a2-4324-8b42-35eba5fa02c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:40.057492 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5a72e0bc-63a2-4324-8b42-35eba5fa02c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:40.057983 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5a72e0bc-63a2-4324-8b42-35eba5fa02c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:40.096391 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-6d421d9a-4e6d-4d44-9000-fe1c362fbb9b req-e85c799e-f5c2-4768-8766-7e58faf1a12a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84831c0d-d0dd-43e7-ae1c-231d7fb307b2", "name": "network-vif-plugged", "status": "completed", "tag": "29fc8120-97c5-4a52-86fc-ca5ec90b971c"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:40.105608 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-6d421d9a-4e6d-4d44-9000-fe1c362fbb9b req-e85c799e-f5c2-4768-8766-7e58faf1a12a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:40.106042 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-6d421d9a-4e6d-4d44-9000-fe1c362fbb9b req-e85c799e-f5c2-4768-8766-7e58faf1a12a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:40.117559 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-6d421d9a-4e6d-4d44-9000-fe1c362fbb9b req-e85c799e-f5c2-4768-8766-7e58faf1a12a service nova] Creating event network-vif-plugged:29fc8120-97c5-4a52-86fc-ca5ec90b971c for instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 on hv-cinder-84980 Jul 14 11:44:40.123225 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-6d421d9a-4e6d-4d44-9000-fe1c362fbb9b req-e85c799e-f5c2-4768-8766-7e58faf1a12a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100702 Jul 14 11:44:40.123831 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 42/75] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:44:40.198057 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5a72e0bc-63a2-4324-8b42-35eba5fa02c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:40.205706 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5a72e0bc-63a2-4324-8b42-35eba5fa02c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1367 microversion: 2.1 time: 0.170110 Jul 14 11:44:40.206485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 34/76] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:40 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:40.556775 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b34f4446-ae26-4891-9d09-968dacf2c551 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:40.556775 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b34f4446-ae26-4891-9d09-968dacf2c551 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:40.563271 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b34f4446-ae26-4891-9d09-968dacf2c551 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:40.564155 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b34f4446-ae26-4891-9d09-968dacf2c551 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:40.565238 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b34f4446-ae26-4891-9d09-968dacf2c551 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:40.565750 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b34f4446-ae26-4891-9d09-968dacf2c551 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:40.587320 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=100 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:40.989653 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b34f4446-ae26-4891-9d09-968dacf2c551 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:40.997759 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b34f4446-ae26-4891-9d09-968dacf2c551 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.446664 Jul 14 11:44:41.001340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 43/77] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:40 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:44:41.037563 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-97061d97-82b8-4145-b2c6-e10e08a59ec6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:41.038173 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-97061d97-82b8-4145-b2c6-e10e08a59ec6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:41.046101 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-97061d97-82b8-4145-b2c6-e10e08a59ec6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:41.046545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-97061d97-82b8-4145-b2c6-e10e08a59ec6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:41.047597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-97061d97-82b8-4145-b2c6-e10e08a59ec6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:41.048527 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-97061d97-82b8-4145-b2c6-e10e08a59ec6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:41.062501 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3af6b09e-6e91-481e-8297-9f13e9e2f771 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:41.063655 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3af6b09e-6e91-481e-8297-9f13e9e2f771 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:41.076293 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3af6b09e-6e91-481e-8297-9f13e9e2f771 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:41.078423 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3af6b09e-6e91-481e-8297-9f13e9e2f771 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:41.081565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3af6b09e-6e91-481e-8297-9f13e9e2f771 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:41.081565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3af6b09e-6e91-481e-8297-9f13e9e2f771 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:41.382165 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3af6b09e-6e91-481e-8297-9f13e9e2f771 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:41.403817 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3af6b09e-6e91-481e-8297-9f13e9e2f771 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:41.406695 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3af6b09e-6e91-481e-8297-9f13e9e2f771 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:41.409971 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3af6b09e-6e91-481e-8297-9f13e9e2f771 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1407 microversion: 2.20 time: 0.353039 Jul 14 11:44:41.424441 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 44/78] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:41 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1407 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:41.448710 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ccb72e9d-aebe-4e28-8489-822136e53cb8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:41.449406 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ccb72e9d-aebe-4e28-8489-822136e53cb8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:41.458906 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ccb72e9d-aebe-4e28-8489-822136e53cb8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:41.459714 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ccb72e9d-aebe-4e28-8489-822136e53cb8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:41.460705 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ccb72e9d-aebe-4e28-8489-822136e53cb8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:41.461408 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ccb72e9d-aebe-4e28-8489-822136e53cb8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:41.640069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-97061d97-82b8-4145-b2c6-e10e08a59ec6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:41.657703 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-97061d97-82b8-4145-b2c6-e10e08a59ec6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1363 microversion: 2.1 time: 0.624147 Jul 14 11:44:41.660597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 35/79] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:41 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1363 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:41.963857 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ccb72e9d-aebe-4e28-8489-822136e53cb8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:41.974077 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ccb72e9d-aebe-4e28-8489-822136e53cb8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1367 microversion: 2.1 time: 0.547782 Jul 14 11:44:41.975161 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 45/80] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:41 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1367 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:42.015167 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c64607ed-ea58-40f5-9a8d-951b2eb7a51e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:42.016730 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c64607ed-ea58-40f5-9a8d-951b2eb7a51e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:42.024037 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c64607ed-ea58-40f5-9a8d-951b2eb7a51e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:42.024982 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c64607ed-ea58-40f5-9a8d-951b2eb7a51e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:42.028400 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c64607ed-ea58-40f5-9a8d-951b2eb7a51e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:42.029073 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c64607ed-ea58-40f5-9a8d-951b2eb7a51e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:42.268682 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-c64607ed-ea58-40f5-9a8d-951b2eb7a51e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:42.278089 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c64607ed-ea58-40f5-9a8d-951b2eb7a51e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.266807 Jul 14 11:44:42.287151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 36/81] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:42 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:42.431234 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b04213d0-f828-4538-927a-71774e194a72 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:42.432807 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b04213d0-f828-4538-927a-71774e194a72 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:42.439288 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b04213d0-f828-4538-927a-71774e194a72 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:42.440190 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b04213d0-f828-4538-927a-71774e194a72 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:42.441111 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b04213d0-f828-4538-927a-71774e194a72 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:42.441565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b04213d0-f828-4538-927a-71774e194a72 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:42.620934 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b04213d0-f828-4538-927a-71774e194a72 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:42.630969 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b04213d0-f828-4538-927a-71774e194a72 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:42.634103 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b04213d0-f828-4538-927a-71774e194a72 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:42.635351 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b04213d0-f828-4538-927a-71774e194a72 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1407 microversion: 2.20 time: 0.208737 Jul 14 11:44:42.637550 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 46/82] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:42 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:42.675651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-32445d52-9368-470b-b4c0-8e7a990c2522 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:42.676554 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-32445d52-9368-470b-b4c0-8e7a990c2522 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:42.684375 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-32445d52-9368-470b-b4c0-8e7a990c2522 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:42.686687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-32445d52-9368-470b-b4c0-8e7a990c2522 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:42.688385 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-32445d52-9368-470b-b4c0-8e7a990c2522 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:42.693033 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-32445d52-9368-470b-b4c0-8e7a990c2522 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:42.883889 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-32445d52-9368-470b-b4c0-8e7a990c2522 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:42.891656 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-32445d52-9368-470b-b4c0-8e7a990c2522 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1363 microversion: 2.1 time: 0.219784 Jul 14 11:44:42.892231 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 37/83] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:42 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:42.991928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-e5fd7994-a71c-41be-8d1b-efbad7e59497 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:42.992756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-e5fd7994-a71c-41be-8d1b-efbad7e59497 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:42.999592 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e5fd7994-a71c-41be-8d1b-efbad7e59497 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:43.000249 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e5fd7994-a71c-41be-8d1b-efbad7e59497 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:43.001185 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e5fd7994-a71c-41be-8d1b-efbad7e59497 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:43.001863 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e5fd7994-a71c-41be-8d1b-efbad7e59497 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:43.211411 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e5fd7994-a71c-41be-8d1b-efbad7e59497 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:43.222464 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-e5fd7994-a71c-41be-8d1b-efbad7e59497 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1367 microversion: 2.1 time: 0.234451 Jul 14 11:44:43.223053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 47/84] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:42 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:43.296196 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9bef599d-9e93-4b6c-8a0c-d86fb7cfc306 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:43.296901 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9bef599d-9e93-4b6c-8a0c-d86fb7cfc306 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:43.304965 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9bef599d-9e93-4b6c-8a0c-d86fb7cfc306 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:43.305525 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9bef599d-9e93-4b6c-8a0c-d86fb7cfc306 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:43.306381 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9bef599d-9e93-4b6c-8a0c-d86fb7cfc306 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:43.306919 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9bef599d-9e93-4b6c-8a0c-d86fb7cfc306 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:43.485737 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9bef599d-9e93-4b6c-8a0c-d86fb7cfc306 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:43.496393 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9bef599d-9e93-4b6c-8a0c-d86fb7cfc306 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.203570 Jul 14 11:44:43.508371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 38/85] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:43 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:43.655229 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b2f97aa0-308b-415b-a866-30f59c3f179a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:43.656228 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b2f97aa0-308b-415b-a866-30f59c3f179a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:43.667254 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2f97aa0-308b-415b-a866-30f59c3f179a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:43.667806 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2f97aa0-308b-415b-a866-30f59c3f179a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:43.669208 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2f97aa0-308b-415b-a866-30f59c3f179a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:43.669890 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2f97aa0-308b-415b-a866-30f59c3f179a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:43.736395 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-7e7f081b-163f-45cc-935c-b4532d7ea227 req-fb627506-c966-42b0-9ed4-520b4673318a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36228e4a-c9d6-4e57-81fe-e8a49d221573", "name": "network-vif-plugged", "status": "completed", "tag": "a691a194-3f01-478d-96f7-2e83d0eb6f7d"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:43.752294 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-7e7f081b-163f-45cc-935c-b4532d7ea227 req-fb627506-c966-42b0-9ed4-520b4673318a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:43.756525 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-7e7f081b-163f-45cc-935c-b4532d7ea227 req-fb627506-c966-42b0-9ed4-520b4673318a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:43.768976 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-7e7f081b-163f-45cc-935c-b4532d7ea227 req-fb627506-c966-42b0-9ed4-520b4673318a service nova] Creating event network-vif-plugged:a691a194-3f01-478d-96f7-2e83d0eb6f7d for instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 on hv-cinder-84980 Jul 14 11:44:43.778404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-7e7f081b-163f-45cc-935c-b4532d7ea227 req-fb627506-c966-42b0-9ed4-520b4673318a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044502 Jul 14 11:44:43.780789 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 39/86] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:44:43.885250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b2f97aa0-308b-415b-a866-30f59c3f179a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:43.897107 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b2f97aa0-308b-415b-a866-30f59c3f179a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:43.898978 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b2f97aa0-308b-415b-a866-30f59c3f179a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:43.900341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b2f97aa0-308b-415b-a866-30f59c3f179a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1407 microversion: 2.20 time: 0.250334 Jul 14 11:44:43.901181 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 48/87] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:43 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:43.910923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4d63e24a-21f2-482e-b892-425908aad592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:43.911856 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-4d63e24a-21f2-482e-b892-425908aad592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:43.925595 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4d63e24a-21f2-482e-b892-425908aad592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:43.927044 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4d63e24a-21f2-482e-b892-425908aad592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:43.932164 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4d63e24a-21f2-482e-b892-425908aad592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:43.932712 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4d63e24a-21f2-482e-b892-425908aad592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:44.110534 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-4d63e24a-21f2-482e-b892-425908aad592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:44.118815 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-4d63e24a-21f2-482e-b892-425908aad592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1363 microversion: 2.1 time: 0.213280 Jul 14 11:44:44.119521 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 40/88] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:43 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:44.240165 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5de83cc9-0192-447c-b16b-780451783b70 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:44.241887 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-5de83cc9-0192-447c-b16b-780451783b70 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:44.250156 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5de83cc9-0192-447c-b16b-780451783b70 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:44.250800 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5de83cc9-0192-447c-b16b-780451783b70 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:44.265860 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5de83cc9-0192-447c-b16b-780451783b70 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:44.267721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5de83cc9-0192-447c-b16b-780451783b70 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:44.455713 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-5de83cc9-0192-447c-b16b-780451783b70 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:44.467931 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-5de83cc9-0192-447c-b16b-780451783b70 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1367 microversion: 2.1 time: 0.231459 Jul 14 11:44:44.477912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 49/89] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:44 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:44.513801 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3439dee4-264d-4c56-92ab-cb78bd8bdb0c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:44.514410 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3439dee4-264d-4c56-92ab-cb78bd8bdb0c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:44.521757 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3439dee4-264d-4c56-92ab-cb78bd8bdb0c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:44.522203 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3439dee4-264d-4c56-92ab-cb78bd8bdb0c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:44.522971 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3439dee4-264d-4c56-92ab-cb78bd8bdb0c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:44.524973 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3439dee4-264d-4c56-92ab-cb78bd8bdb0c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:44.647054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:44.724161 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-3439dee4-264d-4c56-92ab-cb78bd8bdb0c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:44.736895 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=100 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:44.736895 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3439dee4-264d-4c56-92ab-cb78bd8bdb0c tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1315 microversion: 2.1 time: 0.227179 Jul 14 11:44:44.739060 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 41/90] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:44 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:44.920226 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2ac7f0fb-418a-42ae-b06c-8b92b42cc935 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:44.922200 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2ac7f0fb-418a-42ae-b06c-8b92b42cc935 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:44.933987 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ac7f0fb-418a-42ae-b06c-8b92b42cc935 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:44.934657 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ac7f0fb-418a-42ae-b06c-8b92b42cc935 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:44.935860 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ac7f0fb-418a-42ae-b06c-8b92b42cc935 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:44.936558 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ac7f0fb-418a-42ae-b06c-8b92b42cc935 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:45.094254 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2ac7f0fb-418a-42ae-b06c-8b92b42cc935 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:45.102245 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2ac7f0fb-418a-42ae-b06c-8b92b42cc935 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:45.104313 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2ac7f0fb-418a-42ae-b06c-8b92b42cc935 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:45.105439 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2ac7f0fb-418a-42ae-b06c-8b92b42cc935 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1407 microversion: 2.20 time: 0.190346 Jul 14 11:44:45.106010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 50/91] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:44 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:45.135374 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e470bcb9-4123-4a93-8cd5-10679d5d9fb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:45.135996 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e470bcb9-4123-4a93-8cd5-10679d5d9fb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:45.142312 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e470bcb9-4123-4a93-8cd5-10679d5d9fb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:45.142980 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e470bcb9-4123-4a93-8cd5-10679d5d9fb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:45.143741 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e470bcb9-4123-4a93-8cd5-10679d5d9fb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:45.144363 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e470bcb9-4123-4a93-8cd5-10679d5d9fb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:45.325848 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e470bcb9-4123-4a93-8cd5-10679d5d9fb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:45.333977 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e470bcb9-4123-4a93-8cd5-10679d5d9fb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1363 microversion: 2.1 time: 0.202692 Jul 14 11:44:45.334598 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 42/92] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:45 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:45.486247 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b2fa3cea-aa91-4205-b03c-641d2f7673bf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:45.490805 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b2fa3cea-aa91-4205-b03c-641d2f7673bf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:45.496550 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2fa3cea-aa91-4205-b03c-641d2f7673bf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:45.496999 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2fa3cea-aa91-4205-b03c-641d2f7673bf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:45.498075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2fa3cea-aa91-4205-b03c-641d2f7673bf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:45.498691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2fa3cea-aa91-4205-b03c-641d2f7673bf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:45.707564 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b2fa3cea-aa91-4205-b03c-641d2f7673bf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:45.721579 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b2fa3cea-aa91-4205-b03c-641d2f7673bf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1367 microversion: 2.1 time: 0.238840 Jul 14 11:44:45.722243 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 51/93] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:45 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:45.754624 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-eed7cf75-c5ec-4b3e-9d20-0b1eb7480673 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:45.755222 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-eed7cf75-c5ec-4b3e-9d20-0b1eb7480673 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:45.767426 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-eed7cf75-c5ec-4b3e-9d20-0b1eb7480673 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:45.767882 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-eed7cf75-c5ec-4b3e-9d20-0b1eb7480673 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:45.768769 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-eed7cf75-c5ec-4b3e-9d20-0b1eb7480673 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:45.769391 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-eed7cf75-c5ec-4b3e-9d20-0b1eb7480673 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:45.800019 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-2bcd5181-5904-48da-a44e-46cb1c921e34 req-a3765272-684f-4b44-9fa1-294e41fd8227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f44195-49ec-496b-937e-eb9722a215c0", "name": "network-vif-plugged", "status": "completed", "tag": "cf1c50ae-e6c8-42f3-9333-a8eaf141bcd0"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:45.809704 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-2bcd5181-5904-48da-a44e-46cb1c921e34 req-a3765272-684f-4b44-9fa1-294e41fd8227 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:45.810398 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-2bcd5181-5904-48da-a44e-46cb1c921e34 req-a3765272-684f-4b44-9fa1-294e41fd8227 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:45.823296 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-2bcd5181-5904-48da-a44e-46cb1c921e34 req-a3765272-684f-4b44-9fa1-294e41fd8227 service nova] Creating event network-vif-plugged:cf1c50ae-e6c8-42f3-9333-a8eaf141bcd0 for instance 03f44195-49ec-496b-937e-eb9722a215c0 on hv-cinder-84980 Jul 14 11:44:45.828848 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-2bcd5181-5904-48da-a44e-46cb1c921e34 req-a3765272-684f-4b44-9fa1-294e41fd8227 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033850 Jul 14 11:44:45.832400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 52/94] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:44:45.942071 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-eed7cf75-c5ec-4b3e-9d20-0b1eb7480673 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:45.953292 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-eed7cf75-c5ec-4b3e-9d20-0b1eb7480673 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1502 microversion: 2.1 time: 0.202410 Jul 14 11:44:45.954045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 43/95] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:45 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:46.124820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6d09c201-8887-4e28-8d39-698633192767 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:46.125494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6d09c201-8887-4e28-8d39-698633192767 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:46.131927 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6d09c201-8887-4e28-8d39-698633192767 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:46.132380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6d09c201-8887-4e28-8d39-698633192767 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:46.133176 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6d09c201-8887-4e28-8d39-698633192767 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:46.133616 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6d09c201-8887-4e28-8d39-698633192767 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:46.306290 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6d09c201-8887-4e28-8d39-698633192767 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:46.315200 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6d09c201-8887-4e28-8d39-698633192767 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:46.316706 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6d09c201-8887-4e28-8d39-698633192767 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:46.317831 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6d09c201-8887-4e28-8d39-698633192767 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1407 microversion: 2.20 time: 0.198619 Jul 14 11:44:46.318385 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 53/96] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:46 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:46.352529 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-8e33956e-b36e-4104-908c-9f823a601efa tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:46.353395 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-8e33956e-b36e-4104-908c-9f823a601efa tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:46.359437 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8e33956e-b36e-4104-908c-9f823a601efa tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:46.359883 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8e33956e-b36e-4104-908c-9f823a601efa tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:46.360651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8e33956e-b36e-4104-908c-9f823a601efa tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:46.361294 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8e33956e-b36e-4104-908c-9f823a601efa tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:46.501416 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8e33956e-b36e-4104-908c-9f823a601efa tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:46.511245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-8e33956e-b36e-4104-908c-9f823a601efa tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1550 microversion: 2.1 time: 0.162589 Jul 14 11:44:46.512057 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 44/97] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:46 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:46.529723 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d518aa35-b514-4e58-a4b3-b728dfa18859 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:46.530287 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d518aa35-b514-4e58-a4b3-b728dfa18859 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:46.540087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d518aa35-b514-4e58-a4b3-b728dfa18859 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:46.540087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d518aa35-b514-4e58-a4b3-b728dfa18859 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:46.540087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d518aa35-b514-4e58-a4b3-b728dfa18859 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:46.540087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d518aa35-b514-4e58-a4b3-b728dfa18859 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:46.672375 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d518aa35-b514-4e58-a4b3-b728dfa18859 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147177 Jul 14 11:44:46.673130 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 54/98] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jul 14 11:44:46 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/os-interface => generated 285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:44:46.739736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ecd8dae2-7b4c-47db-8acb-acd3fa3a23d8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:46.741334 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ecd8dae2-7b4c-47db-8acb-acd3fa3a23d8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:46.753537 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ecd8dae2-7b4c-47db-8acb-acd3fa3a23d8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:46.753537 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ecd8dae2-7b4c-47db-8acb-acd3fa3a23d8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:46.753537 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ecd8dae2-7b4c-47db-8acb-acd3fa3a23d8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:46.753537 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ecd8dae2-7b4c-47db-8acb-acd3fa3a23d8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:46.905995 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ecd8dae2-7b4c-47db-8acb-acd3fa3a23d8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:46.917899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ecd8dae2-7b4c-47db-8acb-acd3fa3a23d8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1367 microversion: 2.1 time: 0.182315 Jul 14 11:44:46.928043 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 45/99] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:46 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:47.336315 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6d8b5ba7-35d0-4f35-ba90-4140c8b6afa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:47.337066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6d8b5ba7-35d0-4f35-ba90-4140c8b6afa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:47.345363 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6d8b5ba7-35d0-4f35-ba90-4140c8b6afa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:47.346092 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6d8b5ba7-35d0-4f35-ba90-4140c8b6afa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:47.348676 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6d8b5ba7-35d0-4f35-ba90-4140c8b6afa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:47.351487 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6d8b5ba7-35d0-4f35-ba90-4140c8b6afa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:47.644252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:44:47.716925 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6d8b5ba7-35d0-4f35-ba90-4140c8b6afa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:47.731214 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6d8b5ba7-35d0-4f35-ba90-4140c8b6afa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:47.733681 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6d8b5ba7-35d0-4f35-ba90-4140c8b6afa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:47.734829 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6d8b5ba7-35d0-4f35-ba90-4140c8b6afa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1407 microversion: 2.20 time: 0.402897 Jul 14 11:44:47.736287 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 55/100] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:47 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:47.849310 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-ec3b058b-db3d-4dbf-a673-605fc658acf6 req-5035a6c1-ee7c-4023-b020-519921264cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc1d8c0-48e2-49bd-8807-bb041db6a9df", "name": "network-vif-plugged", "status": "completed", "tag": "8ec85559-8aa6-4f19-b912-73c9a2d4d487"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:47.861460 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-ec3b058b-db3d-4dbf-a673-605fc658acf6 req-5035a6c1-ee7c-4023-b020-519921264cb5 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:47.862306 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-ec3b058b-db3d-4dbf-a673-605fc658acf6 req-5035a6c1-ee7c-4023-b020-519921264cb5 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:47.877038 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-ec3b058b-db3d-4dbf-a673-605fc658acf6 req-5035a6c1-ee7c-4023-b020-519921264cb5 service nova] Creating event network-vif-plugged:8ec85559-8aa6-4f19-b912-73c9a2d4d487 for instance edc1d8c0-48e2-49bd-8807-bb041db6a9df on hv-cinder-84980 Jul 14 11:44:47.882876 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-ec3b058b-db3d-4dbf-a673-605fc658acf6 req-5035a6c1-ee7c-4023-b020-519921264cb5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040878 Jul 14 11:44:47.884690 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 46/101] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:44:47.949513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6a25350d-91af-4410-97f7-c037c9b28525 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:47.950142 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6a25350d-91af-4410-97f7-c037c9b28525 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:47.960446 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6a25350d-91af-4410-97f7-c037c9b28525 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:47.961123 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6a25350d-91af-4410-97f7-c037c9b28525 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:47.963615 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6a25350d-91af-4410-97f7-c037c9b28525 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:47.964460 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6a25350d-91af-4410-97f7-c037c9b28525 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:48.020832 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-dd59c40a-a254-4414-a540-8b8bfea028bd tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfcbfad0-6479-4afe-b0c8-149fd0d50e7a"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:48.022112 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-dd59c40a-a254-4414-a540-8b8bfea028bd tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:48.038637 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd59c40a-a254-4414-a540-8b8bfea028bd tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:48.038637 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd59c40a-a254-4414-a540-8b8bfea028bd tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:48.038637 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd59c40a-a254-4414-a540-8b8bfea028bd tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:48.038637 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd59c40a-a254-4414-a540-8b8bfea028bd tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:48.316830 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6a25350d-91af-4410-97f7-c037c9b28525 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:48.326019 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6a25350d-91af-4410-97f7-c037c9b28525 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1367 microversion: 2.1 time: 0.383616 Jul 14 11:44:48.328816 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 56/102] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:47 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:48.623103 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-a4c34e9d-60cf-4161-9bdc-5cff76b5bc61 req-7955e985-1526-4fd1-b5e6-e92e92d16935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36228e4a-c9d6-4e57-81fe-e8a49d221573", "tag": "a691a194-3f01-478d-96f7-2e83d0eb6f7d"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:48.646900 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-a4c34e9d-60cf-4161-9bdc-5cff76b5bc61 req-7955e985-1526-4fd1-b5e6-e92e92d16935 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:48.648358 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-a4c34e9d-60cf-4161-9bdc-5cff76b5bc61 req-7955e985-1526-4fd1-b5e6-e92e92d16935 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:48.665360 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-a4c34e9d-60cf-4161-9bdc-5cff76b5bc61 req-7955e985-1526-4fd1-b5e6-e92e92d16935 service nova] Creating event network-changed:a691a194-3f01-478d-96f7-2e83d0eb6f7d for instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 on hv-cinder-84980 Jul 14 11:44:48.671680 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-a4c34e9d-60cf-4161-9bdc-5cff76b5bc61 req-7955e985-1526-4fd1-b5e6-e92e92d16935 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053523 Jul 14 11:44:48.675334 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 57/103] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:44:48.756392 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c4c36a97-5168-43df-bd6b-bf4997003be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:48.764957 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c4c36a97-5168-43df-bd6b-bf4997003be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:48.773376 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c4c36a97-5168-43df-bd6b-bf4997003be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:48.774495 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c4c36a97-5168-43df-bd6b-bf4997003be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:48.778097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c4c36a97-5168-43df-bd6b-bf4997003be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:48.779820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c4c36a97-5168-43df-bd6b-bf4997003be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:49.012245 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c4c36a97-5168-43df-bd6b-bf4997003be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:49.028411 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c4c36a97-5168-43df-bd6b-bf4997003be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:49.031019 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c4c36a97-5168-43df-bd6b-bf4997003be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:49.032228 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c4c36a97-5168-43df-bd6b-bf4997003be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1599 microversion: 2.20 time: 0.280122 Jul 14 11:44:49.043764 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 58/104] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:44:48 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1599 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:44:49.063627 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-e7574759-80cf-4c8b-9df9-38d6b116d06c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:49.063627 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-e7574759-80cf-4c8b-9df9-38d6b116d06c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:49.064403 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e7574759-80cf-4c8b-9df9-38d6b116d06c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:49.064783 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e7574759-80cf-4c8b-9df9-38d6b116d06c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:49.065850 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e7574759-80cf-4c8b-9df9-38d6b116d06c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:49.066455 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e7574759-80cf-4c8b-9df9-38d6b116d06c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:49.163095 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-e7574759-80cf-4c8b-9df9-38d6b116d06c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.111722 Jul 14 11:44:49.163937 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 59/105] 10.222.0.40 () {60 vars in 1315 bytes} [Thu Jul 14 11:44:49 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 11:44:49.233733 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-dd59c40a-a254-4414-a540-8b8bfea028bd tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "POST /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.217517 Jul 14 11:44:49.241024 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 47/106] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 11:44:48 2022] POST /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2/os-volume_attachments => generated 194 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:44:49.346853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7a3f07c5-64fd-4ec8-841d-8a37a931b13e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:49.347392 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7a3f07c5-64fd-4ec8-841d-8a37a931b13e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:49.359993 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7a3f07c5-64fd-4ec8-841d-8a37a931b13e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:49.360459 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7a3f07c5-64fd-4ec8-841d-8a37a931b13e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:49.361314 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7a3f07c5-64fd-4ec8-841d-8a37a931b13e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:49.364719 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7a3f07c5-64fd-4ec8-841d-8a37a931b13e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:49.675752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7a3f07c5-64fd-4ec8-841d-8a37a931b13e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:49.689204 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7a3f07c5-64fd-4ec8-841d-8a37a931b13e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1367 microversion: 2.1 time: 0.344644 Jul 14 11:44:49.691954 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 60/107] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:49 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:50.711351 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e06d3b73-42da-42ad-a0b2-42bc7b80c188 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:50.711913 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e06d3b73-42da-42ad-a0b2-42bc7b80c188 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:50.724599 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e06d3b73-42da-42ad-a0b2-42bc7b80c188 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:50.726221 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e06d3b73-42da-42ad-a0b2-42bc7b80c188 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:50.727189 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e06d3b73-42da-42ad-a0b2-42bc7b80c188 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:50.727783 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e06d3b73-42da-42ad-a0b2-42bc7b80c188 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:50.981534 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e06d3b73-42da-42ad-a0b2-42bc7b80c188 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:50.992787 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e06d3b73-42da-42ad-a0b2-42bc7b80c188 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1367 microversion: 2.1 time: 0.288397 Jul 14 11:44:51.010516 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 48/108] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:50 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:51.251661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-38bb728a-8438-4b12-bebc-7e7eb28e7571 req-d4e4a22f-d297-4f1f-ba3d-8772fa004eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f44195-49ec-496b-937e-eb9722a215c0", "tag": "cf1c50ae-e6c8-42f3-9333-a8eaf141bcd0"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:51.260909 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-38bb728a-8438-4b12-bebc-7e7eb28e7571 req-d4e4a22f-d297-4f1f-ba3d-8772fa004eff service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:51.261387 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-38bb728a-8438-4b12-bebc-7e7eb28e7571 req-d4e4a22f-d297-4f1f-ba3d-8772fa004eff service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:51.273971 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-38bb728a-8438-4b12-bebc-7e7eb28e7571 req-d4e4a22f-d297-4f1f-ba3d-8772fa004eff service nova] Creating event network-changed:cf1c50ae-e6c8-42f3-9333-a8eaf141bcd0 for instance 03f44195-49ec-496b-937e-eb9722a215c0 on hv-cinder-84980 Jul 14 11:44:51.282720 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-38bb728a-8438-4b12-bebc-7e7eb28e7571 req-d4e4a22f-d297-4f1f-ba3d-8772fa004eff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033914 Jul 14 11:44:51.286237 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 61/109] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:44:52.012830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-8a4e6534-0ee1-449f-8bae-b879784320c1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:52.014111 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-8a4e6534-0ee1-449f-8bae-b879784320c1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:52.020917 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8a4e6534-0ee1-449f-8bae-b879784320c1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:52.021398 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8a4e6534-0ee1-449f-8bae-b879784320c1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:52.022259 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8a4e6534-0ee1-449f-8bae-b879784320c1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:52.022697 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8a4e6534-0ee1-449f-8bae-b879784320c1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:52.211847 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8a4e6534-0ee1-449f-8bae-b879784320c1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:44:52.221076 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-8a4e6534-0ee1-449f-8bae-b879784320c1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1558 microversion: 2.1 time: 0.213267 Jul 14 11:44:52.233917 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 49/110] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:44:52 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:44:52.240943 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-38e57621-f948-4f61-b4ee-1ddb48cbfb6f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:44:52.241721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-38e57621-f948-4f61-b4ee-1ddb48cbfb6f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:44:52.248745 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-38e57621-f948-4f61-b4ee-1ddb48cbfb6f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:52.249229 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-38e57621-f948-4f61-b4ee-1ddb48cbfb6f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:52.250001 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-38e57621-f948-4f61-b4ee-1ddb48cbfb6f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:52.250436 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-38e57621-f948-4f61-b4ee-1ddb48cbfb6f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:52.374742 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-38e57621-f948-4f61-b4ee-1ddb48cbfb6f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.138881 Jul 14 11:44:52.375421 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 62/111] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jul 14 11:44:52 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:44:53.526846 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-a23443b0-9b42-4826-a15b-4a3285296eed req-70cd0eec-a608-4db8-afe6-d88eca9452ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc1d8c0-48e2-49bd-8807-bb041db6a9df", "tag": "8ec85559-8aa6-4f19-b912-73c9a2d4d487"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:44:53.535802 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-a23443b0-9b42-4826-a15b-4a3285296eed req-70cd0eec-a608-4db8-afe6-d88eca9452ab service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:44:53.536247 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-a23443b0-9b42-4826-a15b-4a3285296eed req-70cd0eec-a608-4db8-afe6-d88eca9452ab service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:44:53.547446 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-a23443b0-9b42-4826-a15b-4a3285296eed req-70cd0eec-a608-4db8-afe6-d88eca9452ab service nova] Creating event network-changed:8ec85559-8aa6-4f19-b912-73c9a2d4d487 for instance edc1d8c0-48e2-49bd-8807-bb041db6a9df on hv-cinder-84980 Jul 14 11:44:53.552371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-a23443b0-9b42-4826-a15b-4a3285296eed req-70cd0eec-a608-4db8-afe6-d88eca9452ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030042 Jul 14 11:44:53.553137 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 50/112] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:45:00.823358 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-686b7415-8318-46c9-9a22-19a4caa3c29a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:00.824541 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-686b7415-8318-46c9-9a22-19a4caa3c29a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:00.831176 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-686b7415-8318-46c9-9a22-19a4caa3c29a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:00.832294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-686b7415-8318-46c9-9a22-19a4caa3c29a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:00.834902 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-686b7415-8318-46c9-9a22-19a4caa3c29a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:00.834902 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-686b7415-8318-46c9-9a22-19a4caa3c29a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:00.853324 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=100 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:00.875251 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-686b7415-8318-46c9-9a22-19a4caa3c29a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Going to try to terminate instance {{(pid=124947) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:45:01.329366 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-686b7415-8318-46c9-9a22-19a4caa3c29a tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "DELETE /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 204 len: 0 microversion: 2.1 time: 0.510383 Jul 14 11:45:01.336009 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 63/113] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:45:00 2022] DELETE /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:45:01.347555 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e93beebd-d29b-4c70-b2a9-2c55974ce3f8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:01.349011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e93beebd-d29b-4c70-b2a9-2c55974ce3f8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:01.363038 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e93beebd-d29b-4c70-b2a9-2c55974ce3f8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:01.363700 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e93beebd-d29b-4c70-b2a9-2c55974ce3f8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:01.365053 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e93beebd-d29b-4c70-b2a9-2c55974ce3f8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:01.365708 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e93beebd-d29b-4c70-b2a9-2c55974ce3f8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:01.573955 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e93beebd-d29b-4c70-b2a9-2c55974ce3f8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:01.582714 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e93beebd-d29b-4c70-b2a9-2c55974ce3f8 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1554 microversion: 2.1 time: 0.246602 Jul 14 11:45:01.584212 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 51/114] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:01 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1554 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:02.608756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b7c1d94b-e98a-4b0d-a3b8-0bdc57003c31 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:02.609484 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b7c1d94b-e98a-4b0d-a3b8-0bdc57003c31 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:02.611462 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:02.616485 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b7c1d94b-e98a-4b0d-a3b8-0bdc57003c31 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:02.616963 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b7c1d94b-e98a-4b0d-a3b8-0bdc57003c31 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:02.617752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b7c1d94b-e98a-4b0d-a3b8-0bdc57003c31 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:02.618171 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b7c1d94b-e98a-4b0d-a3b8-0bdc57003c31 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:02.753948 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b7c1d94b-e98a-4b0d-a3b8-0bdc57003c31 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:02.763594 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b7c1d94b-e98a-4b0d-a3b8-0bdc57003c31 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1554 microversion: 2.1 time: 0.159212 Jul 14 11:45:02.764441 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 64/115] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:02 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:03.780194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-50a9cb81-50ed-4743-8147-d991244636b9 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:03.780816 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-50a9cb81-50ed-4743-8147-d991244636b9 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:03.787943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50a9cb81-50ed-4743-8147-d991244636b9 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:03.788385 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50a9cb81-50ed-4743-8147-d991244636b9 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:03.789183 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50a9cb81-50ed-4743-8147-d991244636b9 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:03.789614 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50a9cb81-50ed-4743-8147-d991244636b9 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:04.099573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-50a9cb81-50ed-4743-8147-d991244636b9 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:04.107992 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-50a9cb81-50ed-4743-8147-d991244636b9 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1554 microversion: 2.1 time: 0.331619 Jul 14 11:45:04.108682 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 52/116] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:03 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1554 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:04.383981 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-fe579566-49cc-4342-89d0-e13f038f2229 req-b4615ec0-3526-42b7-8686-df179fe338cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84831c0d-d0dd-43e7-ae1c-231d7fb307b2", "name": "network-vif-deleted", "tag": "29fc8120-97c5-4a52-86fc-ca5ec90b971c"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:45:04.392936 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-fe579566-49cc-4342-89d0-e13f038f2229 req-b4615ec0-3526-42b7-8686-df179fe338cf service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:04.393429 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-fe579566-49cc-4342-89d0-e13f038f2229 req-b4615ec0-3526-42b7-8686-df179fe338cf service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:04.406104 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-fe579566-49cc-4342-89d0-e13f038f2229 req-b4615ec0-3526-42b7-8686-df179fe338cf service nova] Creating event network-vif-deleted:29fc8120-97c5-4a52-86fc-ca5ec90b971c for instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 on hv-cinder-84980 Jul 14 11:45:04.411216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-fe579566-49cc-4342-89d0-e13f038f2229 req-b4615ec0-3526-42b7-8686-df179fe338cf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032499 Jul 14 11:45:04.411859 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 65/117] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:45:05.125146 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-dd00343b-0c59-4a11-8395-3c9e94550072 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:05.125794 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-dd00343b-0c59-4a11-8395-3c9e94550072 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:05.128212 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=59 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:05.133077 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd00343b-0c59-4a11-8395-3c9e94550072 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:05.133635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd00343b-0c59-4a11-8395-3c9e94550072 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:05.134409 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd00343b-0c59-4a11-8395-3c9e94550072 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:05.134877 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd00343b-0c59-4a11-8395-3c9e94550072 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:05.189024 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd00343b-0c59-4a11-8395-3c9e94550072 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:05.189519 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd00343b-0c59-4a11-8395-3c9e94550072 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:05.189998 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-dd00343b-0c59-4a11-8395-3c9e94550072 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lazy-loading 'fault' on Instance uuid 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:45:05.238797 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-dd00343b-0c59-4a11-8395-3c9e94550072 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760c5416ab5c44a59eb03971c2252725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb446eb04c04b73aacbcf5e605a6c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:05.247349 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-dd00343b-0c59-4a11-8395-3c9e94550072 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 200 len: 1351 microversion: 2.1 time: 0.125904 Jul 14 11:45:05.247981 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 53/118] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:05 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 1351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:06.270340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8200c1af-3cb6-44e5-ab01-3e131324a3b3 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:06.271844 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-8200c1af-3cb6-44e5-ab01-3e131324a3b3 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:06.279458 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8200c1af-3cb6-44e5-ab01-3e131324a3b3 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:06.279894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8200c1af-3cb6-44e5-ab01-3e131324a3b3 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:06.280657 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8200c1af-3cb6-44e5-ab01-3e131324a3b3 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:06.281109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8200c1af-3cb6-44e5-ab01-3e131324a3b3 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:06.295280 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-8200c1af-3cb6-44e5-ab01-3e131324a3b3 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] HTTP exception thrown: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8200c1af-3cb6-44e5-ab01-3e131324a3b3 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Request method failure captured: Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 HTTP/1.1 Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AGHCbJ61zex44sgXC1PovXGoN2v_QF_nC2eZniDHOg5VfXORMyI_9hmB_pzCmmupLXPz0-pyfa8gL0cDVe0rHXVAYyuUE75g-lyaxSDxCNLCSa3aUJNmSycfVEupY7wtHWifCjZC7of7HBLEOicSH-4v6bJ10-UTFLZZTKrpjD4wFs Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 5bb446eb04c04b73aacbcf5e605a6c76 Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-DeleteServersTestJSON-444609795 Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:45:06.300262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:45:06.301572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:45:06.301572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-DeleteServersTestJSON-444609795 Jul 14 11:45:06.301572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 5bb446eb04c04b73aacbcf5e605a6c76 Jul 14 11:45:06.301572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-DeleteServersTestJSON-444609795 Jul 14 11:45:06.301572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-DeleteServersTestJSON-444609795-project Jul 14 11:45:06.301572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:45:06.301572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:45:06.301572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 760c5416ab5c44a59eb03971c2252725 Jul 14 11:45:06.301572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-DeleteServersTestJSON-444609795-project Jul 14 11:45:06.301572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:45:06.301572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:06.301572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': '84831c0d-d0dd-43e7-ae1c-231d7fb307b2'} Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:45:06.302235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:06.303678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:45:06.304900 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8200c1af-3cb6-44e5-ab01-3e131324a3b3 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Returning 404 to user: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:45:06.304900 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-8200c1af-3cb6-44e5-ab01-3e131324a3b3 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 404 len: 111 microversion: 2.1 time: 0.035723 Jul 14 11:45:06.304900 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 66/119] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:06 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:45:06.409610 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c04dbf91-cb89-4171-9694-29640ce8e512 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:06.410612 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c04dbf91-cb89-4171-9694-29640ce8e512 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:06.419265 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c04dbf91-cb89-4171-9694-29640ce8e512 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:06.419752 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c04dbf91-cb89-4171-9694-29640ce8e512 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:06.420503 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c04dbf91-cb89-4171-9694-29640ce8e512 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:06.420946 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c04dbf91-cb89-4171-9694-29640ce8e512 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:06.436797 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-c04dbf91-cb89-4171-9694-29640ce8e512 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] HTTP exception thrown: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c04dbf91-cb89-4171-9694-29640ce8e512 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Request method failure captured: Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2/os-volume_attachments HTTP/1.1 Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGHCbJ61zex44sgXC1PovXGoN2v_QF_nC2eZniDHOg5VfXORMyI_9hmB_pzCmmupLXPz0-pyfa8gL0cDVe0rHXVAYyuUE75g-lyaxSDxCNLCSa3aUJNmSycfVEupY7wtHWifCjZC7of7HBLEOicSH-4v6bJ10-UTFLZZTKrpjD4wFs Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 5bb446eb04c04b73aacbcf5e605a6c76 Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-DeleteServersTestJSON-444609795 Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:45:06.442213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:45:06.443740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:45:06.443740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-DeleteServersTestJSON-444609795 Jul 14 11:45:06.443740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 5bb446eb04c04b73aacbcf5e605a6c76 Jul 14 11:45:06.443740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-DeleteServersTestJSON-444609795 Jul 14 11:45:06.443740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-DeleteServersTestJSON-444609795-project Jul 14 11:45:06.443740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:45:06.443740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:45:06.443740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 760c5416ab5c44a59eb03971c2252725 Jul 14 11:45:06.443740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-DeleteServersTestJSON-444609795-project Jul 14 11:45:06.443740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:45:06.443740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:06.443740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'server_id': '84831c0d-d0dd-43e7-ae1c-231d7fb307b2'} Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:45:06.444687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:06.446141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:45:06.448660 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c04dbf91-cb89-4171-9694-29640ce8e512 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Returning 404 to user: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:45:06.449145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c04dbf91-cb89-4171-9694-29640ce8e512 tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044117 Jul 14 11:45:06.450116 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 54/120] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:45:06 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:45:07.850941 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-53e4b58d-f727-4f00-a770-eb5d8b642c5e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:07.851565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-53e4b58d-f727-4f00-a770-eb5d8b642c5e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:07.857676 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-53e4b58d-f727-4f00-a770-eb5d8b642c5e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:07.858121 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-53e4b58d-f727-4f00-a770-eb5d8b642c5e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:07.858891 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-53e4b58d-f727-4f00-a770-eb5d8b642c5e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:07.859324 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-53e4b58d-f727-4f00-a770-eb5d8b642c5e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:07.873469 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-53e4b58d-f727-4f00-a770-eb5d8b642c5e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] HTTP exception thrown: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-53e4b58d-f727-4f00-a770-eb5d8b642c5e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Request method failure captured: Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: DELETE /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 HTTP/1.1 Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AGHCbJ61zex44sgXC1PovXGoN2v_QF_nC2eZniDHOg5VfXORMyI_9hmB_pzCmmupLXPz0-pyfa8gL0cDVe0rHXVAYyuUE75g-lyaxSDxCNLCSa3aUJNmSycfVEupY7wtHWifCjZC7of7HBLEOicSH-4v6bJ10-UTFLZZTKrpjD4wFs Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 5bb446eb04c04b73aacbcf5e605a6c76 Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-DeleteServersTestJSON-444609795 Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:45:07.875091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:45:07.876513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:45:07.876513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-DeleteServersTestJSON-444609795 Jul 14 11:45:07.876513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 5bb446eb04c04b73aacbcf5e605a6c76 Jul 14 11:45:07.876513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-DeleteServersTestJSON-444609795 Jul 14 11:45:07.876513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-DeleteServersTestJSON-444609795-project Jul 14 11:45:07.876513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:45:07.876513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:45:07.876513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 760c5416ab5c44a59eb03971c2252725 Jul 14 11:45:07.876513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-DeleteServersTestJSON-444609795-project Jul 14 11:45:07.876513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:45:07.876513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:07.876513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': '84831c0d-d0dd-43e7-ae1c-231d7fb307b2'} Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:45:07.877342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:07.882881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:45:07.884091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-53e4b58d-f727-4f00-a770-eb5d8b642c5e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Returning 404 to user: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:45:07.884091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-53e4b58d-f727-4f00-a770-eb5d8b642c5e tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "DELETE /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 404 len: 111 microversion: 2.1 time: 0.029655 Jul 14 11:45:07.884091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 67/121] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:45:07 2022] DELETE /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:45:07.889097 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-494bbd81-c09a-470e-9a63-072e30ac713b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:07.889758 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-494bbd81-c09a-470e-9a63-072e30ac713b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] [instance: 84831c0d-d0dd-43e7-ae1c-231d7fb307b2] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:07.897411 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-494bbd81-c09a-470e-9a63-072e30ac713b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:07.897863 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-494bbd81-c09a-470e-9a63-072e30ac713b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:07.898640 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-494bbd81-c09a-470e-9a63-072e30ac713b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:07.899455 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-494bbd81-c09a-470e-9a63-072e30ac713b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:07.916306 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-494bbd81-c09a-470e-9a63-072e30ac713b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] HTTP exception thrown: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-494bbd81-c09a-470e-9a63-072e30ac713b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Request method failure captured: Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 HTTP/1.1 Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGHCbJ61zex44sgXC1PovXGoN2v_QF_nC2eZniDHOg5VfXORMyI_9hmB_pzCmmupLXPz0-pyfa8gL0cDVe0rHXVAYyuUE75g-lyaxSDxCNLCSa3aUJNmSycfVEupY7wtHWifCjZC7of7HBLEOicSH-4v6bJ10-UTFLZZTKrpjD4wFs Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 5bb446eb04c04b73aacbcf5e605a6c76 Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-DeleteServersTestJSON-444609795 Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:45:07.916921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:45:07.918570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5bb446eb04c04b73aacbcf5e605a6c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:45:07.918570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-DeleteServersTestJSON-444609795 Jul 14 11:45:07.918570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 5bb446eb04c04b73aacbcf5e605a6c76 Jul 14 11:45:07.918570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-DeleteServersTestJSON-444609795 Jul 14 11:45:07.918570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-DeleteServersTestJSON-444609795-project Jul 14 11:45:07.918570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:45:07.918570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:45:07.918570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 760c5416ab5c44a59eb03971c2252725 Jul 14 11:45:07.918570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-DeleteServersTestJSON-444609795-project Jul 14 11:45:07.918570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:45:07.918570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:07.918570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '84831c0d-d0dd-43e7-ae1c-231d7fb307b2'} Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:45:07.919447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. Jul 14 11:45:07.920812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:45:07.922014 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-494bbd81-c09a-470e-9a63-072e30ac713b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] Returning 404 to user: Instance 84831c0d-d0dd-43e7-ae1c-231d7fb307b2 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:45:07.922014 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-494bbd81-c09a-470e-9a63-072e30ac713b tempest-DeleteServersTestJSON-444609795 tempest-DeleteServersTestJSON-444609795-project] 10.222.0.40 "GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2" status: 404 len: 111 microversion: 2.1 time: 0.033917 Jul 14 11:45:07.922014 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 55/122] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:07 2022] GET /compute/v2.1/servers/84831c0d-d0dd-43e7-ae1c-231d7fb307b2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:45:20.878309 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=7 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:20.879229 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:21.015202 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-46731018", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:45:21.071079 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.network.neutron [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] validate_networks() for [('ebc2b171-9c41-4e23-a0fc-6ea3655664fa', None, None, None, None, None)] {{(pid=124947) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:45:21.457121 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Flavor limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:45:21.457617 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Image limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:45:21.458273 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Flavor pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:45:21.458684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Image pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:45:21.459096 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:45:21.469950 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:21.470656 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:21.471710 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:21.475298 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:21.510570 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Getting quotas for project 951609a482e34e93908057a68c5dc706. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:45:21.510570 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Getting quotas for user 7bf3f705e04640a2a5d9bedb71c6ccb5 and project 951609a482e34e93908057a68c5dc706. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:45:21.518119 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Going to run 1 instances... {{(pid=124947) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:45:21.520524 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:45:21.727758 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-07fa5f28-e6bf-4cf1-84e9-0b9eb069e6f6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.854445 Jul 14 11:45:21.728407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 68/123] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:45:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:45:21.739608 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-43b171af-a9fe-44d2-9635-41d169b4b21d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:21.740395 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-43b171af-a9fe-44d2-9635-41d169b4b21d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:21.742618 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=7 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:21.743449 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:21.800868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-43b171af-a9fe-44d2-9635-41d169b4b21d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:21.809960 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-43b171af-a9fe-44d2-9635-41d169b4b21d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1220 microversion: 2.1 time: 0.074533 Jul 14 11:45:21.810830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 56/124] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:21 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1220 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:21.897465 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1707512569", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:45:21.968256 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.network.neutron [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] validate_networks() for [('ebc2b171-9c41-4e23-a0fc-6ea3655664fa', None, None, None, None, None)] {{(pid=124947) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:45:22.365313 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Flavor limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:45:22.366451 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Image limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:45:22.366931 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Flavor pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:45:22.367340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Image pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:45:22.367750 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:45:22.378233 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:22.379096 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:22.380057 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:22.380678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:22.400445 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Getting quotas for project 951609a482e34e93908057a68c5dc706. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:45:22.405822 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Getting quotas for user 7bf3f705e04640a2a5d9bedb71c6ccb5 and project 951609a482e34e93908057a68c5dc706. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:45:22.420277 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Going to run 1 instances... {{(pid=124947) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:45:22.427475 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:45:22.553037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-535805e5-37f6-4217-8c6c-4dc34f55ec4f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.660376 Jul 14 11:45:22.557739 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 69/125] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:45:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:45:22.567687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-2cf3e295-9c9f-4352-b0cd-d9ba62011e4e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:22.574495 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-2cf3e295-9c9f-4352-b0cd-d9ba62011e4e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:22.654644 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-2cf3e295-9c9f-4352-b0cd-d9ba62011e4e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:22.671208 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-2cf3e295-9c9f-4352-b0cd-d9ba62011e4e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1222 microversion: 2.1 time: 0.107482 Jul 14 11:45:22.671799 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 57/126] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:22 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:23.692314 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b3844355-f877-4ebf-bddf-0f71d2c1b75c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:23.704744 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b3844355-f877-4ebf-bddf-0f71d2c1b75c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:23.715785 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b3844355-f877-4ebf-bddf-0f71d2c1b75c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:23.716247 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b3844355-f877-4ebf-bddf-0f71d2c1b75c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:23.716996 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b3844355-f877-4ebf-bddf-0f71d2c1b75c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:23.717647 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b3844355-f877-4ebf-bddf-0f71d2c1b75c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:23.794820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b3844355-f877-4ebf-bddf-0f71d2c1b75c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:23.805823 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b3844355-f877-4ebf-bddf-0f71d2c1b75c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1226 microversion: 2.1 time: 0.117960 Jul 14 11:45:23.806740 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 70/127] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:23 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1226 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:24.824759 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-88b4d69c-848b-47dc-834a-be36ee015190 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:24.826412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-88b4d69c-848b-47dc-834a-be36ee015190 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:24.833967 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-88b4d69c-848b-47dc-834a-be36ee015190 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:24.834800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-88b4d69c-848b-47dc-834a-be36ee015190 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:24.835920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-88b4d69c-848b-47dc-834a-be36ee015190 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:24.836581 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-88b4d69c-848b-47dc-834a-be36ee015190 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:24.915826 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-88b4d69c-848b-47dc-834a-be36ee015190 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:24.924270 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-88b4d69c-848b-47dc-834a-be36ee015190 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1274 microversion: 2.1 time: 0.105440 Jul 14 11:45:24.925033 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 58/128] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:24 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:25.947866 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b19ccf92-281d-47a6-a694-eab5a196cf32 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:25.948478 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b19ccf92-281d-47a6-a694-eab5a196cf32 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:25.955490 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b19ccf92-281d-47a6-a694-eab5a196cf32 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:25.955871 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b19ccf92-281d-47a6-a694-eab5a196cf32 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:25.956754 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b19ccf92-281d-47a6-a694-eab5a196cf32 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:25.957336 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b19ccf92-281d-47a6-a694-eab5a196cf32 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:26.045060 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b19ccf92-281d-47a6-a694-eab5a196cf32 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:26.057709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b19ccf92-281d-47a6-a694-eab5a196cf32 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1280 microversion: 2.1 time: 0.112921 Jul 14 11:45:26.058424 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 71/129] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:25 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1280 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:27.079328 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3078ce6d-2d9f-41a8-9b63-75ab3c377974 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:27.079977 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3078ce6d-2d9f-41a8-9b63-75ab3c377974 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:27.091720 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3078ce6d-2d9f-41a8-9b63-75ab3c377974 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:27.095022 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3078ce6d-2d9f-41a8-9b63-75ab3c377974 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:27.096039 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3078ce6d-2d9f-41a8-9b63-75ab3c377974 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:27.098076 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3078ce6d-2d9f-41a8-9b63-75ab3c377974 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:27.538735 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-3078ce6d-2d9f-41a8-9b63-75ab3c377974 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:27.547387 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3078ce6d-2d9f-41a8-9b63-75ab3c377974 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1322 microversion: 2.1 time: 0.475247 Jul 14 11:45:27.556582 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 59/130] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:27 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1322 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:28.248579 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-b58d4155-7bcc-416a-a947-c493eb5061ab req-478f5cc5-e67e-4fb4-a7f3-9adf8f747601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "336dc998-9572-45da-bf2b-b3490712426c", "tag": "f84daf6d-a5b5-4dcc-95ba-a981a1687434"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:45:28.265755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-b58d4155-7bcc-416a-a947-c493eb5061ab req-478f5cc5-e67e-4fb4-a7f3-9adf8f747601 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:28.266195 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-b58d4155-7bcc-416a-a947-c493eb5061ab req-478f5cc5-e67e-4fb4-a7f3-9adf8f747601 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:28.298310 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-b58d4155-7bcc-416a-a947-c493eb5061ab req-478f5cc5-e67e-4fb4-a7f3-9adf8f747601 service nova] Creating event network-changed:f84daf6d-a5b5-4dcc-95ba-a981a1687434 for instance 336dc998-9572-45da-bf2b-b3490712426c on hv-cinder-84980 Jul 14 11:45:28.306695 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-b58d4155-7bcc-416a-a947-c493eb5061ab req-478f5cc5-e67e-4fb4-a7f3-9adf8f747601 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061729 Jul 14 11:45:28.313752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 72/131] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:45:28.564588 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d96b58b3-fba3-43b2-ab95-5a0254a6e716 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:28.565333 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d96b58b3-fba3-43b2-ab95-5a0254a6e716 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:28.572505 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d96b58b3-fba3-43b2-ab95-5a0254a6e716 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:28.573332 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d96b58b3-fba3-43b2-ab95-5a0254a6e716 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:28.576007 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d96b58b3-fba3-43b2-ab95-5a0254a6e716 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:28.576690 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d96b58b3-fba3-43b2-ab95-5a0254a6e716 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:28.777046 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d96b58b3-fba3-43b2-ab95-5a0254a6e716 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:28.785565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d96b58b3-fba3-43b2-ab95-5a0254a6e716 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1322 microversion: 2.1 time: 0.224932 Jul 14 11:45:28.787088 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 60/132] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:28 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:29.806995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c6ba6ffa-2cd4-4f47-abe0-ed1030a41c72 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:29.807709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c6ba6ffa-2cd4-4f47-abe0-ed1030a41c72 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:29.815263 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c6ba6ffa-2cd4-4f47-abe0-ed1030a41c72 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:29.816778 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c6ba6ffa-2cd4-4f47-abe0-ed1030a41c72 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:29.817704 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c6ba6ffa-2cd4-4f47-abe0-ed1030a41c72 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:29.818325 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c6ba6ffa-2cd4-4f47-abe0-ed1030a41c72 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:30.066677 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c6ba6ffa-2cd4-4f47-abe0-ed1030a41c72 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:30.134474 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c6ba6ffa-2cd4-4f47-abe0-ed1030a41c72 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1322 microversion: 2.1 time: 0.333056 Jul 14 11:45:30.135747 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 73/133] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:29 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:30.439167 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-3372315f-4f65-4cc5-a545-191db73672a8 req-ec943c86-dd79-4c6d-aa49-5d7663ee8aee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58800231-da1d-4abc-a4e9-76999be20567", "tag": "cfabf88c-ae26-4c85-af20-c102b65a3c9b"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:45:30.450990 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-3372315f-4f65-4cc5-a545-191db73672a8 req-ec943c86-dd79-4c6d-aa49-5d7663ee8aee service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:30.451704 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-3372315f-4f65-4cc5-a545-191db73672a8 req-ec943c86-dd79-4c6d-aa49-5d7663ee8aee service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:30.469480 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-3372315f-4f65-4cc5-a545-191db73672a8 req-ec943c86-dd79-4c6d-aa49-5d7663ee8aee service nova] Creating event network-changed:cfabf88c-ae26-4c85-af20-c102b65a3c9b for instance 58800231-da1d-4abc-a4e9-76999be20567 on hv-cinder-84980 Jul 14 11:45:30.475335 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-3372315f-4f65-4cc5-a545-191db73672a8 req-ec943c86-dd79-4c6d-aa49-5d7663ee8aee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039945 Jul 14 11:45:30.479290 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 61/134] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:45:31.152843 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-709218d6-c64b-4463-b813-1a9c4619dbfb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:31.154108 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-709218d6-c64b-4463-b813-1a9c4619dbfb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:31.160685 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-709218d6-c64b-4463-b813-1a9c4619dbfb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:31.163562 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-709218d6-c64b-4463-b813-1a9c4619dbfb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:31.169139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-709218d6-c64b-4463-b813-1a9c4619dbfb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:31.169139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-709218d6-c64b-4463-b813-1a9c4619dbfb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:31.416641 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-709218d6-c64b-4463-b813-1a9c4619dbfb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:31.428657 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-709218d6-c64b-4463-b813-1a9c4619dbfb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1322 microversion: 2.1 time: 0.280489 Jul 14 11:45:31.430819 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 74/135] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:31 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:32.447353 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-25cbbd39-9ab7-442b-b6fe-86df1631990a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:32.448396 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-25cbbd39-9ab7-442b-b6fe-86df1631990a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:32.455842 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-25cbbd39-9ab7-442b-b6fe-86df1631990a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:32.456377 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-25cbbd39-9ab7-442b-b6fe-86df1631990a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:32.457265 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-25cbbd39-9ab7-442b-b6fe-86df1631990a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:32.457914 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-25cbbd39-9ab7-442b-b6fe-86df1631990a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:32.653367 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-25cbbd39-9ab7-442b-b6fe-86df1631990a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:32.661980 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=4 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:32.670564 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-25cbbd39-9ab7-442b-b6fe-86df1631990a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1322 microversion: 2.1 time: 0.227775 Jul 14 11:45:32.671170 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 62/136] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:32 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:33.695856 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f6356c85-834d-4f6e-872d-717ec909ae93 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:33.702543 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f6356c85-834d-4f6e-872d-717ec909ae93 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:33.705805 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=4 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:33.712525 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=12 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:33.753856 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f6356c85-834d-4f6e-872d-717ec909ae93 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:33.754321 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f6356c85-834d-4f6e-872d-717ec909ae93 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:33.758006 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f6356c85-834d-4f6e-872d-717ec909ae93 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:33.758472 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f6356c85-834d-4f6e-872d-717ec909ae93 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:33.972038 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f6356c85-834d-4f6e-872d-717ec909ae93 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:33.982976 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f6356c85-834d-4f6e-872d-717ec909ae93 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1322 microversion: 2.1 time: 0.298489 Jul 14 11:45:33.984013 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 75/137] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:33 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:35.001778 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d5cbe873-92dd-4444-8bac-f5dd9b847173 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:35.002587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d5cbe873-92dd-4444-8bac-f5dd9b847173 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:35.010161 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5cbe873-92dd-4444-8bac-f5dd9b847173 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:35.010161 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5cbe873-92dd-4444-8bac-f5dd9b847173 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:35.011119 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5cbe873-92dd-4444-8bac-f5dd9b847173 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:35.011626 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5cbe873-92dd-4444-8bac-f5dd9b847173 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:35.196040 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d5cbe873-92dd-4444-8bac-f5dd9b847173 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:35.206213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d5cbe873-92dd-4444-8bac-f5dd9b847173 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1322 microversion: 2.1 time: 0.210086 Jul 14 11:45:35.207030 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 63/138] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:34 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:36.229503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-37dd8719-5ac7-45f8-bac1-eef084490e90 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:36.231162 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-37dd8719-5ac7-45f8-bac1-eef084490e90 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:36.250346 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-37dd8719-5ac7-45f8-bac1-eef084490e90 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:36.250708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-37dd8719-5ac7-45f8-bac1-eef084490e90 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:36.251494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-37dd8719-5ac7-45f8-bac1-eef084490e90 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:36.251927 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-37dd8719-5ac7-45f8-bac1-eef084490e90 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:36.416417 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-37dd8719-5ac7-45f8-bac1-eef084490e90 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:36.425477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-37dd8719-5ac7-45f8-bac1-eef084490e90 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1322 microversion: 2.1 time: 0.205414 Jul 14 11:45:36.426517 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 76/139] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:36 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:37.269753 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-c762b723-fb4c-4714-9a04-9b6b3103f9bc req-4b8281cf-2e71-4d43-9bef-2476d12eccd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336dc998-9572-45da-bf2b-b3490712426c", "name": "network-vif-plugged", "status": "completed", "tag": "f84daf6d-a5b5-4dcc-95ba-a981a1687434"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:45:37.288239 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-c762b723-fb4c-4714-9a04-9b6b3103f9bc req-4b8281cf-2e71-4d43-9bef-2476d12eccd9 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:37.290841 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-c762b723-fb4c-4714-9a04-9b6b3103f9bc req-4b8281cf-2e71-4d43-9bef-2476d12eccd9 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:37.314152 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-c762b723-fb4c-4714-9a04-9b6b3103f9bc req-4b8281cf-2e71-4d43-9bef-2476d12eccd9 service nova] Creating event network-vif-plugged:f84daf6d-a5b5-4dcc-95ba-a981a1687434 for instance 336dc998-9572-45da-bf2b-b3490712426c on hv-cinder-84980 Jul 14 11:45:37.334198 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-c762b723-fb4c-4714-9a04-9b6b3103f9bc req-4b8281cf-2e71-4d43-9bef-2476d12eccd9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069251 Jul 14 11:45:37.337121 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 64/140] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:45:37.451183 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-24398307-a4bf-4168-a209-1f7aef10ddc9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:37.451794 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-24398307-a4bf-4168-a209-1f7aef10ddc9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:37.460469 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-24398307-a4bf-4168-a209-1f7aef10ddc9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:37.461714 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-24398307-a4bf-4168-a209-1f7aef10ddc9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:37.462683 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-24398307-a4bf-4168-a209-1f7aef10ddc9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:37.464019 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-24398307-a4bf-4168-a209-1f7aef10ddc9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:37.735838 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-24398307-a4bf-4168-a209-1f7aef10ddc9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:37.743352 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-24398307-a4bf-4168-a209-1f7aef10ddc9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1322 microversion: 2.1 time: 0.299377 Jul 14 11:45:37.754273 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 77/141] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:37 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:38.561982 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a9855a7f-28aa-4ff0-9bd4-590e74684354 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:38.562570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a9855a7f-28aa-4ff0-9bd4-590e74684354 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:38.579508 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a9855a7f-28aa-4ff0-9bd4-590e74684354 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:38.580150 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a9855a7f-28aa-4ff0-9bd4-590e74684354 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:38.581136 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a9855a7f-28aa-4ff0-9bd4-590e74684354 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:38.581744 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a9855a7f-28aa-4ff0-9bd4-590e74684354 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:38.637093 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a9855a7f-28aa-4ff0-9bd4-590e74684354 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/ips" status: 200 len: 152 microversion: 2.20 time: 0.079940 Jul 14 11:45:38.637697 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 65/142] 10.222.0.40 () {60 vars in 1288 bytes} [Thu Jul 14 11:45:38 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/ips => generated 152 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:45:38.764519 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a8b3722e-3333-4891-a900-b5b380991189 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:38.771806 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a8b3722e-3333-4891-a900-b5b380991189 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:38.787978 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a8b3722e-3333-4891-a900-b5b380991189 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:38.791036 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a8b3722e-3333-4891-a900-b5b380991189 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:38.792175 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a8b3722e-3333-4891-a900-b5b380991189 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:38.795441 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a8b3722e-3333-4891-a900-b5b380991189 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:39.114252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a8b3722e-3333-4891-a900-b5b380991189 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:39.122576 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a8b3722e-3333-4891-a900-b5b380991189 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1322 microversion: 2.1 time: 0.365486 Jul 14 11:45:39.123469 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 78/143] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:38 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:39.357101 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-d5845480-bd5c-4b68-a62f-f8cee5978f6d req-f9b8550a-19bd-4430-9b98-d4f7d97370ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58800231-da1d-4abc-a4e9-76999be20567", "name": "network-vif-plugged", "status": "completed", "tag": "cfabf88c-ae26-4c85-af20-c102b65a3c9b"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:45:39.374309 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-d5845480-bd5c-4b68-a62f-f8cee5978f6d req-f9b8550a-19bd-4430-9b98-d4f7d97370ea service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:39.375143 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-d5845480-bd5c-4b68-a62f-f8cee5978f6d req-f9b8550a-19bd-4430-9b98-d4f7d97370ea service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:39.395790 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-d5845480-bd5c-4b68-a62f-f8cee5978f6d req-f9b8550a-19bd-4430-9b98-d4f7d97370ea service nova] Creating event network-vif-plugged:cfabf88c-ae26-4c85-af20-c102b65a3c9b for instance 58800231-da1d-4abc-a4e9-76999be20567 on hv-cinder-84980 Jul 14 11:45:39.402393 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-d5845480-bd5c-4b68-a62f-f8cee5978f6d req-f9b8550a-19bd-4430-9b98-d4f7d97370ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048286 Jul 14 11:45:39.403003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 66/144] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:45:39.497247 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-4a6495bd-8c13-4842-8f57-7e2dccbff6ee tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:39.498149 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-4a6495bd-8c13-4842-8f57-7e2dccbff6ee tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:39.504721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4a6495bd-8c13-4842-8f57-7e2dccbff6ee tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:39.505504 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4a6495bd-8c13-4842-8f57-7e2dccbff6ee tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:39.506546 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4a6495bd-8c13-4842-8f57-7e2dccbff6ee tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:39.506979 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4a6495bd-8c13-4842-8f57-7e2dccbff6ee tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:39.549500 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-4a6495bd-8c13-4842-8f57-7e2dccbff6ee tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df/ips" status: 200 len: 150 microversion: 2.1 time: 0.056990 Jul 14 11:45:39.553668 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 79/145] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 11:45:39 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df/ips => generated 150 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:45:40.145546 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5259a9da-b70f-45ad-bcfd-3c0b902e718a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:40.145968 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5259a9da-b70f-45ad-bcfd-3c0b902e718a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:40.155971 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5259a9da-b70f-45ad-bcfd-3c0b902e718a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:40.158363 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5259a9da-b70f-45ad-bcfd-3c0b902e718a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:40.159895 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5259a9da-b70f-45ad-bcfd-3c0b902e718a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:40.160586 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5259a9da-b70f-45ad-bcfd-3c0b902e718a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:40.390043 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5259a9da-b70f-45ad-bcfd-3c0b902e718a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:40.399639 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5259a9da-b70f-45ad-bcfd-3c0b902e718a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1322 microversion: 2.1 time: 0.259507 Jul 14 11:45:40.406327 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 67/146] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:40 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:41.416356 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7f99306d-f2b8-4f97-bdd4-61752c642d59 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:41.416945 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7f99306d-f2b8-4f97-bdd4-61752c642d59 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:41.423585 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7f99306d-f2b8-4f97-bdd4-61752c642d59 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:41.424036 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7f99306d-f2b8-4f97-bdd4-61752c642d59 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:41.425005 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7f99306d-f2b8-4f97-bdd4-61752c642d59 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:41.425475 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7f99306d-f2b8-4f97-bdd4-61752c642d59 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:41.616930 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7f99306d-f2b8-4f97-bdd4-61752c642d59 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:41.624702 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7f99306d-f2b8-4f97-bdd4-61752c642d59 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1322 microversion: 2.1 time: 0.212750 Jul 14 11:45:41.625308 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 80/147] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:41 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:42.249142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-7c2f8d39-167a-4632-8f4d-ea3d80c6cf10 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82c9edf1-12cf-4a6d-9e2b-976024f6c6e9"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:45:42.250856 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-7c2f8d39-167a-4632-8f4d-ea3d80c6cf10 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:42.262987 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7c2f8d39-167a-4632-8f4d-ea3d80c6cf10 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:42.263433 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7c2f8d39-167a-4632-8f4d-ea3d80c6cf10 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:42.264386 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7c2f8d39-167a-4632-8f4d-ea3d80c6cf10 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:42.264972 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7c2f8d39-167a-4632-8f4d-ea3d80c6cf10 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:42.517140 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-41db22c6-2398-4af2-b11b-f1f5c346b543 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Action: 'create', calling method: .version_select at 0x7f1ae4224160>, body: {"keypair": {"name": "tempest-TestShelveInstance-350530210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC79Q9jvn267g3H68WAlg0OLCHgHGv6/E8sqP/zIEs+o9u+rm+Psp4eOVdgGC+w7FNcfmXGGgkJ2/BMuTF3lFTxuq594jxGPCiBeD7+CyLAGjMnEsRecQdDvachEEsjaWA=="}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:45:42.533263 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-41db22c6-2398-4af2-b11b-f1f5c346b543 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Getting quotas for project ca23768669a74586a221c14ebaa8ee26. Resources: {'key_pairs'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:45:42.538462 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-41db22c6-2398-4af2-b11b-f1f5c346b543 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Getting quotas for user d352cf5c00ae450c9a7ca4dcc68a87db and project ca23768669a74586a221c14ebaa8ee26. Resources: {'key_pairs'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:45:42.670656 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-41db22c6-2398-4af2-b11b-f1f5c346b543 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.378485 Jul 14 11:45:42.672902 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 81/148] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 11:45:42 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:45:42.691236 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-78a9c389-c9fe-4e98-8f1f-99b553db8ca1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:45:42.693779 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-78a9c389-c9fe-4e98-8f1f-99b553db8ca1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:42.705079 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-78a9c389-c9fe-4e98-8f1f-99b553db8ca1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:42.705079 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-78a9c389-c9fe-4e98-8f1f-99b553db8ca1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:42.705079 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-78a9c389-c9fe-4e98-8f1f-99b553db8ca1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:42.705079 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-78a9c389-c9fe-4e98-8f1f-99b553db8ca1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:42.753028 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-78a9c389-c9fe-4e98-8f1f-99b553db8ca1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lazy-loading 'flavor' on Instance uuid 03f44195-49ec-496b-937e-eb9722a215c0 {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:45:43.236208 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-7c2f8d39-167a-4632-8f4d-ea3d80c6cf10 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "POST /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991446 Jul 14 11:45:43.243222 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 68/149] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 11:45:42 2022] POST /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df/os-volume_attachments => generated 194 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:45:43.256391 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3ff6f898-af49-4e8f-8ab7-68ee993f8e0b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:43.257897 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3ff6f898-af49-4e8f-8ab7-68ee993f8e0b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:43.276210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3ff6f898-af49-4e8f-8ab7-68ee993f8e0b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:43.277531 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3ff6f898-af49-4e8f-8ab7-68ee993f8e0b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:43.278575 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3ff6f898-af49-4e8f-8ab7-68ee993f8e0b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:43.279521 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3ff6f898-af49-4e8f-8ab7-68ee993f8e0b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:43.459337 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-3ff6f898-af49-4e8f-8ab7-68ee993f8e0b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:43.470484 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3ff6f898-af49-4e8f-8ab7-68ee993f8e0b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1516 microversion: 2.1 time: 0.232320 Jul 14 11:45:43.471260 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 69/150] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:43 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:43.500233 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c8adf207-6f25-44a0-a926-69b42af78cae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:45:43.506138 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c8adf207-6f25-44a0-a926-69b42af78cae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:43.517190 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c8adf207-6f25-44a0-a926-69b42af78cae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:43.517732 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c8adf207-6f25-44a0-a926-69b42af78cae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:43.518607 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c8adf207-6f25-44a0-a926-69b42af78cae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:43.519136 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c8adf207-6f25-44a0-a926-69b42af78cae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:43.542860 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-78a9c389-c9fe-4e98-8f1f-99b553db8ca1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "POST /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/action" status: 202 len: 0 microversion: 2.20 time: 0.867614 Jul 14 11:45:43.548758 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 82/151] 10.222.0.40 () {62 vars in 1318 bytes} [Thu Jul 14 11:45:42 2022] POST /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/action => generated 0 bytes in 875 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:45:43.560469 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-713e437e-768d-4767-9a36-ae121dfe90ee tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:43.560855 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-713e437e-768d-4767-9a36-ae121dfe90ee tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:43.575045 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-713e437e-768d-4767-9a36-ae121dfe90ee tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:43.575492 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-713e437e-768d-4767-9a36-ae121dfe90ee tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:43.576696 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-c8adf207-6f25-44a0-a926-69b42af78cae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lazy-loading 'flavor' on Instance uuid 58800231-da1d-4abc-a4e9-76999be20567 {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:45:43.578348 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-713e437e-768d-4767-9a36-ae121dfe90ee tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:43.578896 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-713e437e-768d-4767-9a36-ae121dfe90ee tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:43.770054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-713e437e-768d-4767-9a36-ae121dfe90ee tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:43.779358 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-713e437e-768d-4767-9a36-ae121dfe90ee tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:43.781379 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-713e437e-768d-4767-9a36-ae121dfe90ee tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:43.782575 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-713e437e-768d-4767-9a36-ae121dfe90ee tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.228767 Jul 14 11:45:43.783137 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 83/152] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:45:43 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:45:44.005144 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c8adf207-6f25-44a0-a926-69b42af78cae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "POST /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567/action" status: 200 len: 32 microversion: 2.1 time: 0.513350 Jul 14 11:45:44.005969 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 70/153] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 11:45:43 2022] POST /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567/action => generated 32 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:45:44.018806 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f7bbfd25-2b14-45f9-81e3-d2eda918c7a3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:44.019445 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f7bbfd25-2b14-45f9-81e3-d2eda918c7a3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:44.033144 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f7bbfd25-2b14-45f9-81e3-d2eda918c7a3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:44.033706 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f7bbfd25-2b14-45f9-81e3-d2eda918c7a3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:44.034556 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f7bbfd25-2b14-45f9-81e3-d2eda918c7a3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:44.038136 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f7bbfd25-2b14-45f9-81e3-d2eda918c7a3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:44.206359 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f7bbfd25-2b14-45f9-81e3-d2eda918c7a3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:44.213823 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f7bbfd25-2b14-45f9-81e3-d2eda918c7a3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.199105 Jul 14 11:45:44.214677 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 84/154] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:44 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:44.733961 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-0f95f5d3-7a63-49e8-abce-2206d4897219 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:44.734678 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-0f95f5d3-7a63-49e8-abce-2206d4897219 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:44.749902 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0f95f5d3-7a63-49e8-abce-2206d4897219 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:44.750353 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0f95f5d3-7a63-49e8-abce-2206d4897219 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:44.751142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0f95f5d3-7a63-49e8-abce-2206d4897219 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:44.751572 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0f95f5d3-7a63-49e8-abce-2206d4897219 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:44.800899 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a16464ad-1ce9-4f3a-8af0-9d9949449499 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:44.802465 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a16464ad-1ce9-4f3a-8af0-9d9949449499 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:44.816921 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a16464ad-1ce9-4f3a-8af0-9d9949449499 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:44.817863 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a16464ad-1ce9-4f3a-8af0-9d9949449499 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:44.821826 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-0f95f5d3-7a63-49e8-abce-2206d4897219 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/ips" status: 200 len: 146 microversion: 2.1 time: 0.091645 Jul 14 11:45:44.822370 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a16464ad-1ce9-4f3a-8af0-9d9949449499 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:44.823017 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a16464ad-1ce9-4f3a-8af0-9d9949449499 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:44.824804 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 71/155] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 11:45:44 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/ips => generated 146 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:45:45.041858 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a16464ad-1ce9-4f3a-8af0-9d9949449499 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:45.050539 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:45.056037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a16464ad-1ce9-4f3a-8af0-9d9949449499 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:45.057708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a16464ad-1ce9-4f3a-8af0-9d9949449499 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:45.058936 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a16464ad-1ce9-4f3a-8af0-9d9949449499 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.262290 Jul 14 11:45:45.070109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 85/156] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:45:44 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:45:45.235478 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-7e3f6dfd-8da0-4d77-956f-199eaa2c1c6d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:45.236443 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-7e3f6dfd-8da0-4d77-956f-199eaa2c1c6d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:45.246599 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7e3f6dfd-8da0-4d77-956f-199eaa2c1c6d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:45.247868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7e3f6dfd-8da0-4d77-956f-199eaa2c1c6d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:45.248652 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7e3f6dfd-8da0-4d77-956f-199eaa2c1c6d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:45.249218 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7e3f6dfd-8da0-4d77-956f-199eaa2c1c6d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:45.687134 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-7e3f6dfd-8da0-4d77-956f-199eaa2c1c6d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:45.699788 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-7e3f6dfd-8da0-4d77-956f-199eaa2c1c6d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.469065 Jul 14 11:45:45.700394 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 72/157] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:45 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:46.079756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a74eedc3-a113-4171-a8b8-56c5769fdc23 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:46.080988 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a74eedc3-a113-4171-a8b8-56c5769fdc23 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:46.092473 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a74eedc3-a113-4171-a8b8-56c5769fdc23 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:46.093292 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a74eedc3-a113-4171-a8b8-56c5769fdc23 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:46.094105 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a74eedc3-a113-4171-a8b8-56c5769fdc23 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:46.094548 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a74eedc3-a113-4171-a8b8-56c5769fdc23 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:46.254699 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a74eedc3-a113-4171-a8b8-56c5769fdc23 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:46.263712 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a74eedc3-a113-4171-a8b8-56c5769fdc23 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:46.265274 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a74eedc3-a113-4171-a8b8-56c5769fdc23 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:46.267178 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a74eedc3-a113-4171-a8b8-56c5769fdc23 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.192613 Jul 14 11:45:46.267741 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 86/158] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:45:46 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:45:46.717494 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-094914a8-24cc-42d4-b5e0-d66274a9acda tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:46.718114 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-094914a8-24cc-42d4-b5e0-d66274a9acda tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:46.728306 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-094914a8-24cc-42d4-b5e0-d66274a9acda tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:46.728753 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-094914a8-24cc-42d4-b5e0-d66274a9acda tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:46.729660 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-094914a8-24cc-42d4-b5e0-d66274a9acda tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:46.730740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-094914a8-24cc-42d4-b5e0-d66274a9acda tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:46.970441 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-094914a8-24cc-42d4-b5e0-d66274a9acda tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:46.974233 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:46.980952 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-094914a8-24cc-42d4-b5e0-d66274a9acda tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.269046 Jul 14 11:45:46.982646 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 73/159] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:46 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:47.286072 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-287daf8a-c2b1-4bc7-9d47-26c7a98b882b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:47.286868 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-287daf8a-c2b1-4bc7-9d47-26c7a98b882b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:47.294381 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-287daf8a-c2b1-4bc7-9d47-26c7a98b882b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:47.295028 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-287daf8a-c2b1-4bc7-9d47-26c7a98b882b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:47.296101 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-287daf8a-c2b1-4bc7-9d47-26c7a98b882b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:47.296852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-287daf8a-c2b1-4bc7-9d47-26c7a98b882b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:47.464298 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-287daf8a-c2b1-4bc7-9d47-26c7a98b882b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:47.472829 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-287daf8a-c2b1-4bc7-9d47-26c7a98b882b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:47.475405 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-287daf8a-c2b1-4bc7-9d47-26c7a98b882b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:47.484581 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-287daf8a-c2b1-4bc7-9d47-26c7a98b882b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.194738 Jul 14 11:45:47.484581 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 87/160] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:45:47 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:45:47.509669 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-cef6d05a-0479-48b0-98f4-c1d3e34a4110 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00a61e73-58f4-4072-9e86-0e137dafff06"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:45:47.509669 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-cef6d05a-0479-48b0-98f4-c1d3e34a4110 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:47.511985 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cef6d05a-0479-48b0-98f4-c1d3e34a4110 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:47.512433 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cef6d05a-0479-48b0-98f4-c1d3e34a4110 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:47.513237 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cef6d05a-0479-48b0-98f4-c1d3e34a4110 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:47.513677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cef6d05a-0479-48b0-98f4-c1d3e34a4110 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:47.998555 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6f5147b4-17db-4ebc-9e04-9d511ccf1523 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:47.999208 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6f5147b4-17db-4ebc-9e04-9d511ccf1523 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:48.005511 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6f5147b4-17db-4ebc-9e04-9d511ccf1523 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:48.006007 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6f5147b4-17db-4ebc-9e04-9d511ccf1523 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:48.006772 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6f5147b4-17db-4ebc-9e04-9d511ccf1523 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:48.007203 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6f5147b4-17db-4ebc-9e04-9d511ccf1523 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:48.146696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6f5147b4-17db-4ebc-9e04-9d511ccf1523 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:48.155041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6f5147b4-17db-4ebc-9e04-9d511ccf1523 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.161244 Jul 14 11:45:48.155602 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 88/161] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:47 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:45:48.446340 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-cef6d05a-0479-48b0-98f4-c1d3e34a4110 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "POST /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.946279 Jul 14 11:45:48.446951 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 74/162] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 11:45:47 2022] POST /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/os-volume_attachments => generated 194 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:45:48.496395 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-01726aa7-e74c-4e15-b2c4-df5c255d1589 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:48.497119 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-01726aa7-e74c-4e15-b2c4-df5c255d1589 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:48.504554 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-01726aa7-e74c-4e15-b2c4-df5c255d1589 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:48.505356 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-01726aa7-e74c-4e15-b2c4-df5c255d1589 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:48.506498 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-01726aa7-e74c-4e15-b2c4-df5c255d1589 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:48.507024 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-01726aa7-e74c-4e15-b2c4-df5c255d1589 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:48.717911 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-01726aa7-e74c-4e15-b2c4-df5c255d1589 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:48.726378 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-01726aa7-e74c-4e15-b2c4-df5c255d1589 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:48.727933 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-01726aa7-e74c-4e15-b2c4-df5c255d1589 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:48.729122 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-01726aa7-e74c-4e15-b2c4-df5c255d1589 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.237521 Jul 14 11:45:48.743805 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 89/163] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:45:48 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:45:49.172029 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-36b3b961-f90b-4e01-8b0d-edd1c8531fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:49.173010 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-36b3b961-f90b-4e01-8b0d-edd1c8531fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:49.180209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-36b3b961-f90b-4e01-8b0d-edd1c8531fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:49.180661 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-36b3b961-f90b-4e01-8b0d-edd1c8531fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:49.181584 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-36b3b961-f90b-4e01-8b0d-edd1c8531fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:49.182092 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-36b3b961-f90b-4e01-8b0d-edd1c8531fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:49.333211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-36b3b961-f90b-4e01-8b0d-edd1c8531fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:49.345070 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-36b3b961-f90b-4e01-8b0d-edd1c8531fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.176854 Jul 14 11:45:49.346068 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 75/164] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:49 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:49.759977 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-170fa88b-979f-4817-a4ed-bd9ba50d1f8f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:49.760745 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-170fa88b-979f-4817-a4ed-bd9ba50d1f8f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:49.767305 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-170fa88b-979f-4817-a4ed-bd9ba50d1f8f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:49.767826 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-170fa88b-979f-4817-a4ed-bd9ba50d1f8f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:49.768526 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-170fa88b-979f-4817-a4ed-bd9ba50d1f8f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:49.768952 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-170fa88b-979f-4817-a4ed-bd9ba50d1f8f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:49.917038 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-170fa88b-979f-4817-a4ed-bd9ba50d1f8f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:49.928945 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-170fa88b-979f-4817-a4ed-bd9ba50d1f8f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:49.934455 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-170fa88b-979f-4817-a4ed-bd9ba50d1f8f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:49.934455 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-170fa88b-979f-4817-a4ed-bd9ba50d1f8f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.176965 Jul 14 11:45:49.934455 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 90/165] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:45:49 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:45:50.379536 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-21fd50af-a841-4489-937e-9037e9199e8e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:50.380152 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-21fd50af-a841-4489-937e-9037e9199e8e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:50.388175 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-21fd50af-a841-4489-937e-9037e9199e8e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:50.388619 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-21fd50af-a841-4489-937e-9037e9199e8e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:50.389446 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-21fd50af-a841-4489-937e-9037e9199e8e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:50.390045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-21fd50af-a841-4489-937e-9037e9199e8e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:50.565593 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-21fd50af-a841-4489-937e-9037e9199e8e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:50.575438 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-21fd50af-a841-4489-937e-9037e9199e8e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.209882 Jul 14 11:45:50.576043 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 76/166] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:50 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:50.951172 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-11737617-3112-4596-b115-87838cbd2415 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:50.951685 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-11737617-3112-4596-b115-87838cbd2415 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:50.957978 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-11737617-3112-4596-b115-87838cbd2415 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:50.958419 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-11737617-3112-4596-b115-87838cbd2415 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:50.959184 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-11737617-3112-4596-b115-87838cbd2415 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:50.959623 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-11737617-3112-4596-b115-87838cbd2415 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:51.112373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-11737617-3112-4596-b115-87838cbd2415 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:51.121675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-11737617-3112-4596-b115-87838cbd2415 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:51.123204 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-11737617-3112-4596-b115-87838cbd2415 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:51.124369 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-11737617-3112-4596-b115-87838cbd2415 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.178052 Jul 14 11:45:51.124921 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 91/167] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:45:50 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:45:51.513118 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-45da83a2-6668-4b9f-8525-09735358328f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Action: 'create', calling method: .version_select at 0x7f1ae40f58b0>, body: {"keypair": {"name": "tempest-keypair-135430694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4d5KekmsnL5Df6HMef76HYwTbuiy5Hxwii2694W8pOpHyYDdXoiHAM77WMEjchkSi/xaAFPNYUIAB0WrcbYaxGnbp8CPMjWrZAZpRFkFQc27yoxsySDWVLfxB4hLW2/Q=="}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:45:51.535731 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-45da83a2-6668-4b9f-8525-09735358328f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for project f274d555f5c746cc885394c699b3d767. Resources: {'key_pairs'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:45:51.540005 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-45da83a2-6668-4b9f-8525-09735358328f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for user 8773c88f88614a9d903f667305a217e0 and project f274d555f5c746cc885394c699b3d767. Resources: {'key_pairs'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:45:51.592696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-50d80d4c-3e3e-4c05-93d1-9ca53d42b031 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:51.593305 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-50d80d4c-3e3e-4c05-93d1-9ca53d42b031 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:51.595445 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:51.601149 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-50d80d4c-3e3e-4c05-93d1-9ca53d42b031 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:51.601736 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-50d80d4c-3e3e-4c05-93d1-9ca53d42b031 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:51.602615 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-50d80d4c-3e3e-4c05-93d1-9ca53d42b031 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:51.603097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-50d80d4c-3e3e-4c05-93d1-9ca53d42b031 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:51.652134 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-45da83a2-6668-4b9f-8525-09735358328f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.142702 Jul 14 11:45:51.653042 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 77/168] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 11:45:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:45:51.747083 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-50d80d4c-3e3e-4c05-93d1-9ca53d42b031 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:51.754762 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-50d80d4c-3e3e-4c05-93d1-9ca53d42b031 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.166674 Jul 14 11:45:51.759658 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 92/169] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:51 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:45:52.143330 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-8d349d16-a137-4ba9-a2db-5666181bff39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:52.143985 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-8d349d16-a137-4ba9-a2db-5666181bff39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:52.150592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8d349d16-a137-4ba9-a2db-5666181bff39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:52.151050 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8d349d16-a137-4ba9-a2db-5666181bff39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:52.152436 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8d349d16-a137-4ba9-a2db-5666181bff39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:52.152874 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8d349d16-a137-4ba9-a2db-5666181bff39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:52.308961 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8d349d16-a137-4ba9-a2db-5666181bff39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:52.318727 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8d349d16-a137-4ba9-a2db-5666181bff39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:52.320492 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8d349d16-a137-4ba9-a2db-5666181bff39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:52.321839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-8d349d16-a137-4ba9-a2db-5666181bff39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.182639 Jul 14 11:45:52.322406 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 78/170] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:45:52 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:45:52.771843 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-40f69ced-0c5e-402e-9109-c3d9c5749581 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:52.772588 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-40f69ced-0c5e-402e-9109-c3d9c5749581 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:52.775008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=4 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:52.780233 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-40f69ced-0c5e-402e-9109-c3d9c5749581 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:52.780683 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-40f69ced-0c5e-402e-9109-c3d9c5749581 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:52.781639 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-40f69ced-0c5e-402e-9109-c3d9c5749581 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:52.787232 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-40f69ced-0c5e-402e-9109-c3d9c5749581 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:52.943280 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-40f69ced-0c5e-402e-9109-c3d9c5749581 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:52.951169 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-40f69ced-0c5e-402e-9109-c3d9c5749581 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.183115 Jul 14 11:45:52.951640 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 93/171] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:52 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:53.340255 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d8de2b94-ded5-4ba8-b249-a12b751b35dd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:53.340863 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d8de2b94-ded5-4ba8-b249-a12b751b35dd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:53.344100 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:53.349251 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d8de2b94-ded5-4ba8-b249-a12b751b35dd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:53.349655 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d8de2b94-ded5-4ba8-b249-a12b751b35dd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:53.350421 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d8de2b94-ded5-4ba8-b249-a12b751b35dd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:53.350849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d8de2b94-ded5-4ba8-b249-a12b751b35dd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:53.538470 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d8de2b94-ded5-4ba8-b249-a12b751b35dd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:53.548723 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d8de2b94-ded5-4ba8-b249-a12b751b35dd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:53.550098 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d8de2b94-ded5-4ba8-b249-a12b751b35dd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:53.551650 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d8de2b94-ded5-4ba8-b249-a12b751b35dd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.215627 Jul 14 11:45:53.552230 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 79/172] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:45:53 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:45:53.969608 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-e8a508b6-fb2c-4504-b024-48b0cb90eaa1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:53.970283 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-e8a508b6-fb2c-4504-b024-48b0cb90eaa1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:53.976646 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e8a508b6-fb2c-4504-b024-48b0cb90eaa1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:53.977097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e8a508b6-fb2c-4504-b024-48b0cb90eaa1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:53.977875 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e8a508b6-fb2c-4504-b024-48b0cb90eaa1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:53.978331 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e8a508b6-fb2c-4504-b024-48b0cb90eaa1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:54.124508 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e8a508b6-fb2c-4504-b024-48b0cb90eaa1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:54.133143 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-e8a508b6-fb2c-4504-b024-48b0cb90eaa1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.168984 Jul 14 11:45:54.133877 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 94/173] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:53 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:54.295321 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-201686974", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce6397ea-e1d9-4c18-9185-6161e76618d7"}], "security_groups": [{"name": "tempest-securitygroup--175292245"}], "key_name": "tempest-keypair-135430694", "user_data": "}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:45:54.570541 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-029809e2-6d11-4ad9-9e30-ea3926a2703d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:54.571162 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-029809e2-6d11-4ad9-9e30-ea3926a2703d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:54.577834 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-029809e2-6d11-4ad9-9e30-ea3926a2703d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:54.578339 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-029809e2-6d11-4ad9-9e30-ea3926a2703d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:54.579058 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-029809e2-6d11-4ad9-9e30-ea3926a2703d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:54.579498 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-029809e2-6d11-4ad9-9e30-ea3926a2703d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:54.719167 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-029809e2-6d11-4ad9-9e30-ea3926a2703d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:54.728962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-029809e2-6d11-4ad9-9e30-ea3926a2703d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:54.730776 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-029809e2-6d11-4ad9-9e30-ea3926a2703d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:54.732046 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-029809e2-6d11-4ad9-9e30-ea3926a2703d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.165591 Jul 14 11:45:54.732835 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 95/174] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:45:54 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:45:55.151481 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-0c1c5b4c-15aa-41ab-9265-686de5db5624 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:55.152167 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-0c1c5b4c-15aa-41ab-9265-686de5db5624 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:55.158218 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0c1c5b4c-15aa-41ab-9265-686de5db5624 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:55.158663 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0c1c5b4c-15aa-41ab-9265-686de5db5624 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:55.159426 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0c1c5b4c-15aa-41ab-9265-686de5db5624 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:55.160159 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0c1c5b4c-15aa-41ab-9265-686de5db5624 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:55.303484 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-0c1c5b4c-15aa-41ab-9265-686de5db5624 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:55.314905 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-0c1c5b4c-15aa-41ab-9265-686de5db5624 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.167460 Jul 14 11:45:55.318155 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 96/175] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:55 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:45:55.751266 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-dbd538f6-5d7d-4eb4-a30f-1ec3be5b7425 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:55.752049 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-dbd538f6-5d7d-4eb4-a30f-1ec3be5b7425 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:55.758071 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dbd538f6-5d7d-4eb4-a30f-1ec3be5b7425 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:55.758644 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dbd538f6-5d7d-4eb4-a30f-1ec3be5b7425 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:55.759405 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dbd538f6-5d7d-4eb4-a30f-1ec3be5b7425 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:55.759841 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dbd538f6-5d7d-4eb4-a30f-1ec3be5b7425 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:55.892490 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-dbd538f6-5d7d-4eb4-a30f-1ec3be5b7425 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:55.900814 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-dbd538f6-5d7d-4eb4-a30f-1ec3be5b7425 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:55.902892 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-dbd538f6-5d7d-4eb4-a30f-1ec3be5b7425 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:55.904090 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-dbd538f6-5d7d-4eb4-a30f-1ec3be5b7425 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.156874 Jul 14 11:45:55.904648 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 97/176] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:45:55 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:45:56.338038 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d46cb9fd-dfd5-4694-991b-051023a9d3f4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:56.338679 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d46cb9fd-dfd5-4694-991b-051023a9d3f4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:56.344806 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d46cb9fd-dfd5-4694-991b-051023a9d3f4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:56.345383 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d46cb9fd-dfd5-4694-991b-051023a9d3f4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:56.346063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d46cb9fd-dfd5-4694-991b-051023a9d3f4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:56.346484 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d46cb9fd-dfd5-4694-991b-051023a9d3f4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:56.482890 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d46cb9fd-dfd5-4694-991b-051023a9d3f4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:56.490588 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d46cb9fd-dfd5-4694-991b-051023a9d3f4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.156552 Jul 14 11:45:56.491169 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 98/177] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:56 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:45:56.924286 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5359b0c8-5b02-47e5-97bf-74231385cf68 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:56.924925 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-5359b0c8-5b02-47e5-97bf-74231385cf68 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:56.931029 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5359b0c8-5b02-47e5-97bf-74231385cf68 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:56.931481 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5359b0c8-5b02-47e5-97bf-74231385cf68 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:56.932250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5359b0c8-5b02-47e5-97bf-74231385cf68 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:56.932686 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5359b0c8-5b02-47e5-97bf-74231385cf68 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:57.283177 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-5359b0c8-5b02-47e5-97bf-74231385cf68 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:57.283177 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-5359b0c8-5b02-47e5-97bf-74231385cf68 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:57.284252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-5359b0c8-5b02-47e5-97bf-74231385cf68 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:57.284252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-5359b0c8-5b02-47e5-97bf-74231385cf68 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.173090 Jul 14 11:45:57.284252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 99/178] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:45:56 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:45:57.508013 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3662dc46-fde0-4cae-b7a9-28eb8fabb4e5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:57.508744 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3662dc46-fde0-4cae-b7a9-28eb8fabb4e5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:57.515281 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3662dc46-fde0-4cae-b7a9-28eb8fabb4e5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:57.515721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3662dc46-fde0-4cae-b7a9-28eb8fabb4e5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:57.516523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3662dc46-fde0-4cae-b7a9-28eb8fabb4e5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:57.516962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3662dc46-fde0-4cae-b7a9-28eb8fabb4e5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:57.655859 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3662dc46-fde0-4cae-b7a9-28eb8fabb4e5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:57.663715 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3662dc46-fde0-4cae-b7a9-28eb8fabb4e5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.159670 Jul 14 11:45:57.664291 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 100/179] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:57 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:45:58.293479 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-bde567e0-9e4d-47e7-96ad-e443694112cd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:58.294124 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-bde567e0-9e4d-47e7-96ad-e443694112cd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:58.300178 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bde567e0-9e4d-47e7-96ad-e443694112cd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:58.300616 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bde567e0-9e4d-47e7-96ad-e443694112cd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:58.301485 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bde567e0-9e4d-47e7-96ad-e443694112cd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:58.301928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bde567e0-9e4d-47e7-96ad-e443694112cd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:58.462589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-bde567e0-9e4d-47e7-96ad-e443694112cd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:58.468228 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-bde567e0-9e4d-47e7-96ad-e443694112cd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:58.469873 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-bde567e0-9e4d-47e7-96ad-e443694112cd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:58.471472 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-bde567e0-9e4d-47e7-96ad-e443694112cd tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.181891 Jul 14 11:45:58.472503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 101/180] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:45:58 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:45:58.497812 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-027de799-4ecd-4a87-aa0a-4479ae030c8d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:45:58.504008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-027de799-4ecd-4a87-aa0a-4479ae030c8d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:58.504452 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-027de799-4ecd-4a87-aa0a-4479ae030c8d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:58.562125 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=100 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:45:58.568733 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-027de799-4ecd-4a87-aa0a-4479ae030c8d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Going to try to stop instance {{(pid=124947) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 11:45:58.777034 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-027de799-4ecd-4a87-aa0a-4479ae030c8d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "POST /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/action" status: 202 len: 0 microversion: 2.1 time: 0.282928 Jul 14 11:45:58.777720 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 102/181] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 11:45:58 2022] POST /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:45:58.783704 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-409abf76-88cc-42d7-8114-793517040e8f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:58.784416 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-409abf76-88cc-42d7-8114-793517040e8f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:58.790843 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-409abf76-88cc-42d7-8114-793517040e8f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:58.791297 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-409abf76-88cc-42d7-8114-793517040e8f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:58.792084 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-409abf76-88cc-42d7-8114-793517040e8f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:58.792521 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-409abf76-88cc-42d7-8114-793517040e8f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:58.938765 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-409abf76-88cc-42d7-8114-793517040e8f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:58.948750 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-409abf76-88cc-42d7-8114-793517040e8f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.169786 Jul 14 11:45:58.949639 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 103/182] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:58 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:58.954685 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-90c411a1-e699-4f53-b6a9-0231aa7283c5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:58.955292 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-90c411a1-e699-4f53-b6a9-0231aa7283c5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:58.962419 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90c411a1-e699-4f53-b6a9-0231aa7283c5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:58.963191 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90c411a1-e699-4f53-b6a9-0231aa7283c5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:58.964539 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90c411a1-e699-4f53-b6a9-0231aa7283c5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:58.965832 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90c411a1-e699-4f53-b6a9-0231aa7283c5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:59.111537 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-90c411a1-e699-4f53-b6a9-0231aa7283c5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:59.122451 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-90c411a1-e699-4f53-b6a9-0231aa7283c5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1724 microversion: 2.1 time: 0.171795 Jul 14 11:45:59.123036 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 104/183] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:58 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:45:59.491010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6b4d9271-8305-44ca-8da0-b25bc49b2aa9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:59.491775 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6b4d9271-8305-44ca-8da0-b25bc49b2aa9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:59.499105 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6b4d9271-8305-44ca-8da0-b25bc49b2aa9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:59.503600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6b4d9271-8305-44ca-8da0-b25bc49b2aa9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:59.503600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6b4d9271-8305-44ca-8da0-b25bc49b2aa9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:59.503600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6b4d9271-8305-44ca-8da0-b25bc49b2aa9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:59.637471 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6b4d9271-8305-44ca-8da0-b25bc49b2aa9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:59.645430 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6b4d9271-8305-44ca-8da0-b25bc49b2aa9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:59.646959 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6b4d9271-8305-44ca-8da0-b25bc49b2aa9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:45:59.648127 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6b4d9271-8305-44ca-8da0-b25bc49b2aa9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.161233 Jul 14 11:45:59.648684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 105/184] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:45:59 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:45:59.965426 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c2dd3bfc-8fe9-4dfe-9818-701a03739756 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:45:59.965954 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c2dd3bfc-8fe9-4dfe-9818-701a03739756 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:45:59.972961 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c2dd3bfc-8fe9-4dfe-9818-701a03739756 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:59.973493 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c2dd3bfc-8fe9-4dfe-9818-701a03739756 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:45:59.974330 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c2dd3bfc-8fe9-4dfe-9818-701a03739756 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:45:59.974777 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c2dd3bfc-8fe9-4dfe-9818-701a03739756 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:00.114136 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c2dd3bfc-8fe9-4dfe-9818-701a03739756 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:00.122249 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c2dd3bfc-8fe9-4dfe-9818-701a03739756 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.160745 Jul 14 11:46:00.122820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 106/185] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:45:59 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:00.139610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3c470634-4ea9-4d97-af20-7e599e091c46 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:00.140220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3c470634-4ea9-4d97-af20-7e599e091c46 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:00.146332 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3c470634-4ea9-4d97-af20-7e599e091c46 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:00.146778 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3c470634-4ea9-4d97-af20-7e599e091c46 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:00.147538 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3c470634-4ea9-4d97-af20-7e599e091c46 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:00.147975 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3c470634-4ea9-4d97-af20-7e599e091c46 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:00.511226 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3c470634-4ea9-4d97-af20-7e599e091c46 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:00.519911 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3c470634-4ea9-4d97-af20-7e599e091c46 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1724 microversion: 2.1 time: 0.383921 Jul 14 11:46:00.526283 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 107/186] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:00 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1724 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:00.667137 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3c0da497-9d78-45a5-8e9d-68d9fd0fdd3a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:00.668341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3c0da497-9d78-45a5-8e9d-68d9fd0fdd3a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:00.674615 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3c0da497-9d78-45a5-8e9d-68d9fd0fdd3a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:00.675073 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3c0da497-9d78-45a5-8e9d-68d9fd0fdd3a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:00.675837 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3c0da497-9d78-45a5-8e9d-68d9fd0fdd3a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:00.676266 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3c0da497-9d78-45a5-8e9d-68d9fd0fdd3a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:00.806984 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3c0da497-9d78-45a5-8e9d-68d9fd0fdd3a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:00.815887 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3c0da497-9d78-45a5-8e9d-68d9fd0fdd3a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:00.817492 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3c0da497-9d78-45a5-8e9d-68d9fd0fdd3a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:00.818700 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3c0da497-9d78-45a5-8e9d-68d9fd0fdd3a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.155531 Jul 14 11:46:00.819262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 108/187] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:00 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:01.138810 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-cfdc383a-52ee-4f20-a012-2833960cde74 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:01.139321 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-cfdc383a-52ee-4f20-a012-2833960cde74 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:01.145912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cfdc383a-52ee-4f20-a012-2833960cde74 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:01.146380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cfdc383a-52ee-4f20-a012-2833960cde74 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:01.147141 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cfdc383a-52ee-4f20-a012-2833960cde74 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:01.147576 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cfdc383a-52ee-4f20-a012-2833960cde74 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:01.422676 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-cfdc383a-52ee-4f20-a012-2833960cde74 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:01.430174 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-cfdc383a-52ee-4f20-a012-2833960cde74 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.295783 Jul 14 11:46:01.440693 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 109/188] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:01 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:01.544238 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-025fe8f0-448e-4e12-a359-75fd20581119 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:01.544887 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-025fe8f0-448e-4e12-a359-75fd20581119 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:01.551027 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-025fe8f0-448e-4e12-a359-75fd20581119 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:01.551476 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-025fe8f0-448e-4e12-a359-75fd20581119 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:01.551745 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=4 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:01.552436 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-025fe8f0-448e-4e12-a359-75fd20581119 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:01.552662 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-025fe8f0-448e-4e12-a359-75fd20581119 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:01.685869 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-025fe8f0-448e-4e12-a359-75fd20581119 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:01.695230 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-025fe8f0-448e-4e12-a359-75fd20581119 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1724 microversion: 2.1 time: 0.155323 Jul 14 11:46:01.695756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 110/189] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:01 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:01.837815 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d2828a80-43c6-4c07-874c-83e23cc9001a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:01.838431 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d2828a80-43c6-4c07-874c-83e23cc9001a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:01.844668 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d2828a80-43c6-4c07-874c-83e23cc9001a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:01.845118 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d2828a80-43c6-4c07-874c-83e23cc9001a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:01.845920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d2828a80-43c6-4c07-874c-83e23cc9001a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:01.846356 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d2828a80-43c6-4c07-874c-83e23cc9001a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:01.991133 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d2828a80-43c6-4c07-874c-83e23cc9001a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:02.002101 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d2828a80-43c6-4c07-874c-83e23cc9001a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:02.003683 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d2828a80-43c6-4c07-874c-83e23cc9001a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:02.004898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d2828a80-43c6-4c07-874c-83e23cc9001a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.171374 Jul 14 11:46:02.005482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 111/190] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:01 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:46:02.447537 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-0206af81-0960-460a-8fad-c805715d4994 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:02.448140 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-0206af81-0960-460a-8fad-c805715d4994 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:02.454629 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0206af81-0960-460a-8fad-c805715d4994 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:02.455073 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0206af81-0960-460a-8fad-c805715d4994 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:02.455830 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0206af81-0960-460a-8fad-c805715d4994 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:02.456266 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0206af81-0960-460a-8fad-c805715d4994 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:02.596482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-0206af81-0960-460a-8fad-c805715d4994 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:02.608306 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-0206af81-0960-460a-8fad-c805715d4994 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.164507 Jul 14 11:46:02.608892 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 112/191] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:02 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:02.712666 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a21ec7b5-1bdf-43ee-9680-53f439d5767f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:02.713322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a21ec7b5-1bdf-43ee-9680-53f439d5767f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:02.719226 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a21ec7b5-1bdf-43ee-9680-53f439d5767f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:02.719670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a21ec7b5-1bdf-43ee-9680-53f439d5767f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:02.720428 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a21ec7b5-1bdf-43ee-9680-53f439d5767f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:02.720866 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a21ec7b5-1bdf-43ee-9680-53f439d5767f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:02.854616 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a21ec7b5-1bdf-43ee-9680-53f439d5767f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:02.862601 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a21ec7b5-1bdf-43ee-9680-53f439d5767f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1724 microversion: 2.1 time: 0.153893 Jul 14 11:46:02.863162 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 113/192] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:02 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:03.026071 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a42a1d9e-856a-4f63-9254-e1d9f7f50b59 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:03.026699 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a42a1d9e-856a-4f63-9254-e1d9f7f50b59 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:03.033747 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a42a1d9e-856a-4f63-9254-e1d9f7f50b59 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:03.034311 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a42a1d9e-856a-4f63-9254-e1d9f7f50b59 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:03.035241 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a42a1d9e-856a-4f63-9254-e1d9f7f50b59 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:03.035736 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a42a1d9e-856a-4f63-9254-e1d9f7f50b59 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:03.170533 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a42a1d9e-856a-4f63-9254-e1d9f7f50b59 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:03.178509 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a42a1d9e-856a-4f63-9254-e1d9f7f50b59 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:03.180024 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a42a1d9e-856a-4f63-9254-e1d9f7f50b59 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:03.181369 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a42a1d9e-856a-4f63-9254-e1d9f7f50b59 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.160898 Jul 14 11:46:03.181746 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 114/193] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:03 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:46:03.543235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:03.625813 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2ed19d91-b2a9-4f0b-bd06-1907fce59cad tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:03.626434 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2ed19d91-b2a9-4f0b-bd06-1907fce59cad tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:03.632752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ed19d91-b2a9-4f0b-bd06-1907fce59cad tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:03.633433 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ed19d91-b2a9-4f0b-bd06-1907fce59cad tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:03.634180 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ed19d91-b2a9-4f0b-bd06-1907fce59cad tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:03.634620 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ed19d91-b2a9-4f0b-bd06-1907fce59cad tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:03.774768 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2ed19d91-b2a9-4f0b-bd06-1907fce59cad tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:03.782947 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2ed19d91-b2a9-4f0b-bd06-1907fce59cad tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.161706 Jul 14 11:46:03.783524 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 115/194] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:03 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:03.880229 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-febbc77c-82f9-4a68-a8bd-1d19be79e38a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:03.880835 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-febbc77c-82f9-4a68-a8bd-1d19be79e38a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:03.886895 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-febbc77c-82f9-4a68-a8bd-1d19be79e38a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:03.887344 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-febbc77c-82f9-4a68-a8bd-1d19be79e38a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:03.888108 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-febbc77c-82f9-4a68-a8bd-1d19be79e38a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:03.888544 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-febbc77c-82f9-4a68-a8bd-1d19be79e38a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:04.023783 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-febbc77c-82f9-4a68-a8bd-1d19be79e38a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:04.032199 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-febbc77c-82f9-4a68-a8bd-1d19be79e38a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1724 microversion: 2.1 time: 0.156281 Jul 14 11:46:04.032758 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 116/195] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:03 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:04.198413 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-af8c9f20-a77a-4ae4-84d6-14cbffb9707f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:04.199636 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-af8c9f20-a77a-4ae4-84d6-14cbffb9707f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:04.206073 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-af8c9f20-a77a-4ae4-84d6-14cbffb9707f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:04.206519 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-af8c9f20-a77a-4ae4-84d6-14cbffb9707f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:04.207299 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-af8c9f20-a77a-4ae4-84d6-14cbffb9707f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:04.207732 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-af8c9f20-a77a-4ae4-84d6-14cbffb9707f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:04.218362 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.network.neutron [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] validate_networks() for [('ce6397ea-e1d9-4c18-9185-6161e76618d7', None, None, None, None, None)] {{(pid=124946) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:46:04.346085 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-af8c9f20-a77a-4ae4-84d6-14cbffb9707f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:04.354570 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-af8c9f20-a77a-4ae4-84d6-14cbffb9707f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:04.356132 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-af8c9f20-a77a-4ae4-84d6-14cbffb9707f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:04.357379 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-af8c9f20-a77a-4ae4-84d6-14cbffb9707f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.162854 Jul 14 11:46:04.357940 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 117/196] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:04 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:46:04.389942 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=3 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:04.600238 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Flavor limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:46:04.600797 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Image limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:46:04.601186 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Flavor pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:46:04.601630 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Image pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:46:04.602074 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:46:04.611842 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:04.612292 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:04.613097 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:04.613566 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:04.629855 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for project f274d555f5c746cc885394c699b3d767. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:46:04.633781 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for user 8773c88f88614a9d903f667305a217e0 and project f274d555f5c746cc885394c699b3d767. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:46:04.645342 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Going to run 1 instances... {{(pid=124946) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:46:04.647551 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124946) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:46:04.778117 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-591ed74e-1918-405e-a3f0-f5316d30c165 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 10.486846 Jul 14 11:46:04.782638 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 80/197] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:45:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 10489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:46:04.791299 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f092ebe5-1ec6-41cf-bd7d-8c32909694ca tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:04.791920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f092ebe5-1ec6-41cf-bd7d-8c32909694ca tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:04.800063 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6f3a9554-216e-4d9c-987e-33b14922590b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:04.800679 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6f3a9554-216e-4d9c-987e-33b14922590b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:04.807103 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6f3a9554-216e-4d9c-987e-33b14922590b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:04.807545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6f3a9554-216e-4d9c-987e-33b14922590b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:04.808310 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6f3a9554-216e-4d9c-987e-33b14922590b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:04.808765 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6f3a9554-216e-4d9c-987e-33b14922590b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:04.847357 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f092ebe5-1ec6-41cf-bd7d-8c32909694ca tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:04.854426 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f092ebe5-1ec6-41cf-bd7d-8c32909694ca tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1240 microversion: 2.1 time: 0.067024 Jul 14 11:46:04.865631 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 118/198] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:04 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:04.944998 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6f3a9554-216e-4d9c-987e-33b14922590b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:04.953538 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6f3a9554-216e-4d9c-987e-33b14922590b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.157707 Jul 14 11:46:04.954116 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 81/199] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:04 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:05.049308 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2a19cb8d-2104-4f7c-98a5-acbd0bfefeb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:05.049916 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2a19cb8d-2104-4f7c-98a5-acbd0bfefeb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:05.055955 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2a19cb8d-2104-4f7c-98a5-acbd0bfefeb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:05.056399 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2a19cb8d-2104-4f7c-98a5-acbd0bfefeb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:05.057212 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2a19cb8d-2104-4f7c-98a5-acbd0bfefeb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:05.057746 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2a19cb8d-2104-4f7c-98a5-acbd0bfefeb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:05.062374 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:05.193784 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2a19cb8d-2104-4f7c-98a5-acbd0bfefeb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:05.202687 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2a19cb8d-2104-4f7c-98a5-acbd0bfefeb8 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1724 microversion: 2.1 time: 0.157304 Jul 14 11:46:05.203264 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 119/200] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:05 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:05.375617 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-19f1a4a3-c5a2-470e-b49e-221ccda7153b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:05.376227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-19f1a4a3-c5a2-470e-b49e-221ccda7153b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:05.382971 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-19f1a4a3-c5a2-470e-b49e-221ccda7153b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:05.383423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-19f1a4a3-c5a2-470e-b49e-221ccda7153b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:05.384278 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-19f1a4a3-c5a2-470e-b49e-221ccda7153b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:05.384682 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-19f1a4a3-c5a2-470e-b49e-221ccda7153b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:05.518556 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-19f1a4a3-c5a2-470e-b49e-221ccda7153b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:05.526776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-19f1a4a3-c5a2-470e-b49e-221ccda7153b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:05.528899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-19f1a4a3-c5a2-470e-b49e-221ccda7153b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:05.530086 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-19f1a4a3-c5a2-470e-b49e-221ccda7153b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1745 microversion: 2.20 time: 0.158464 Jul 14 11:46:05.530651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 82/201] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:05 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:05.875102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5c28f8cc-3df7-497e-84f0-bd9611234e31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:05.875698 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-5c28f8cc-3df7-497e-84f0-bd9611234e31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:05.883620 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5c28f8cc-3df7-497e-84f0-bd9611234e31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:05.888906 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5c28f8cc-3df7-497e-84f0-bd9611234e31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:05.888906 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5c28f8cc-3df7-497e-84f0-bd9611234e31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:05.888906 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5c28f8cc-3df7-497e-84f0-bd9611234e31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:05.948856 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-5c28f8cc-3df7-497e-84f0-bd9611234e31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:05.957042 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-5c28f8cc-3df7-497e-84f0-bd9611234e31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1244 microversion: 2.1 time: 0.089196 Jul 14 11:46:05.957645 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 120/202] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:05 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:05.970045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a78b6128-1ad2-4c16-965f-85c353e67d60 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:05.970752 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a78b6128-1ad2-4c16-965f-85c353e67d60 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:05.977302 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a78b6128-1ad2-4c16-965f-85c353e67d60 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:05.977834 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a78b6128-1ad2-4c16-965f-85c353e67d60 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:05.978677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a78b6128-1ad2-4c16-965f-85c353e67d60 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:05.979191 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a78b6128-1ad2-4c16-965f-85c353e67d60 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:06.141936 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a78b6128-1ad2-4c16-965f-85c353e67d60 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:06.149642 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a78b6128-1ad2-4c16-965f-85c353e67d60 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.183297 Jul 14 11:46:06.150227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 83/203] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:05 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:06.220875 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b4ee7ff6-07bb-4f50-b14d-f2d7c7a642dc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:06.221223 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b4ee7ff6-07bb-4f50-b14d-f2d7c7a642dc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:06.227620 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b4ee7ff6-07bb-4f50-b14d-f2d7c7a642dc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:06.228080 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b4ee7ff6-07bb-4f50-b14d-f2d7c7a642dc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:06.228860 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b4ee7ff6-07bb-4f50-b14d-f2d7c7a642dc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:06.229389 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b4ee7ff6-07bb-4f50-b14d-f2d7c7a642dc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:06.365330 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b4ee7ff6-07bb-4f50-b14d-f2d7c7a642dc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:06.374248 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b4ee7ff6-07bb-4f50-b14d-f2d7c7a642dc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1724 microversion: 2.1 time: 0.158073 Jul 14 11:46:06.374886 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 121/204] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:06 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:06.548981 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4259d0f4-9d2a-42e8-a43d-e9092f401913 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:06.549604 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-4259d0f4-9d2a-42e8-a43d-e9092f401913 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:06.560366 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4259d0f4-9d2a-42e8-a43d-e9092f401913 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:06.560366 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4259d0f4-9d2a-42e8-a43d-e9092f401913 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:06.560366 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4259d0f4-9d2a-42e8-a43d-e9092f401913 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:06.560366 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4259d0f4-9d2a-42e8-a43d-e9092f401913 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:06.689947 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-4259d0f4-9d2a-42e8-a43d-e9092f401913 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:06.697954 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-4259d0f4-9d2a-42e8-a43d-e9092f401913 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:06.699469 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-4259d0f4-9d2a-42e8-a43d-e9092f401913 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:06.700672 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-4259d0f4-9d2a-42e8-a43d-e9092f401913 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1745 microversion: 2.20 time: 0.155607 Jul 14 11:46:06.701343 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 84/205] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:06 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:06.974909 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-16f925ed-c410-47b5-8314-2b5abf2a13c2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:06.975977 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-16f925ed-c410-47b5-8314-2b5abf2a13c2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:06.983168 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-16f925ed-c410-47b5-8314-2b5abf2a13c2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:06.983620 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-16f925ed-c410-47b5-8314-2b5abf2a13c2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:06.984386 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-16f925ed-c410-47b5-8314-2b5abf2a13c2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:06.984818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-16f925ed-c410-47b5-8314-2b5abf2a13c2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:07.050904 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-16f925ed-c410-47b5-8314-2b5abf2a13c2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:07.058722 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-16f925ed-c410-47b5-8314-2b5abf2a13c2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1300 microversion: 2.1 time: 0.088463 Jul 14 11:46:07.059232 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 122/206] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:06 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:07.166846 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-83ac06d2-2fca-4778-be7c-bd4564a0d485 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:07.167466 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-83ac06d2-2fca-4778-be7c-bd4564a0d485 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:07.173631 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-83ac06d2-2fca-4778-be7c-bd4564a0d485 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:07.174078 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-83ac06d2-2fca-4778-be7c-bd4564a0d485 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:07.175048 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-83ac06d2-2fca-4778-be7c-bd4564a0d485 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:07.175482 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-83ac06d2-2fca-4778-be7c-bd4564a0d485 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:07.306987 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-83ac06d2-2fca-4778-be7c-bd4564a0d485 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:07.316659 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-83ac06d2-2fca-4778-be7c-bd4564a0d485 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.152315 Jul 14 11:46:07.316659 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 85/207] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:07 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:07.392098 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3a089f74-b1ec-4764-81d2-108b14e8ac51 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:07.392721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3a089f74-b1ec-4764-81d2-108b14e8ac51 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:07.400765 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3a089f74-b1ec-4764-81d2-108b14e8ac51 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:07.401297 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3a089f74-b1ec-4764-81d2-108b14e8ac51 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:07.402140 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3a089f74-b1ec-4764-81d2-108b14e8ac51 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:07.402582 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3a089f74-b1ec-4764-81d2-108b14e8ac51 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:07.543842 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3a089f74-b1ec-4764-81d2-108b14e8ac51 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:07.552962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3a089f74-b1ec-4764-81d2-108b14e8ac51 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1724 microversion: 2.1 time: 0.164230 Jul 14 11:46:07.553430 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 123/208] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:07 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:07.720578 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b9a86b80-a89a-42df-b48c-5a7dcbbaad8b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:07.721165 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b9a86b80-a89a-42df-b48c-5a7dcbbaad8b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:07.727937 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b9a86b80-a89a-42df-b48c-5a7dcbbaad8b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:07.728391 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b9a86b80-a89a-42df-b48c-5a7dcbbaad8b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:07.729181 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b9a86b80-a89a-42df-b48c-5a7dcbbaad8b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:07.729635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b9a86b80-a89a-42df-b48c-5a7dcbbaad8b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:07.927638 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b9a86b80-a89a-42df-b48c-5a7dcbbaad8b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:07.938570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b9a86b80-a89a-42df-b48c-5a7dcbbaad8b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:07.940105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b9a86b80-a89a-42df-b48c-5a7dcbbaad8b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:07.941513 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b9a86b80-a89a-42df-b48c-5a7dcbbaad8b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1745 microversion: 2.20 time: 0.224941 Jul 14 11:46:07.942074 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 86/209] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:07 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1745 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:08.077647 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-e461f056-a55d-4cae-9f01-7852c869b1fe tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:08.079202 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-e461f056-a55d-4cae-9f01-7852c869b1fe tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:08.082170 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-0501686d-07d7-4431-bd8a-65e885366916 req-9c95bf6f-4789-4318-bffc-e76350189b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f44195-49ec-496b-937e-eb9722a215c0", "name": "network-vif-plugged", "status": "completed", "tag": "cf1c50ae-e6c8-42f3-9333-a8eaf141bcd0"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:46:08.087415 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e461f056-a55d-4cae-9f01-7852c869b1fe tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:08.090297 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e461f056-a55d-4cae-9f01-7852c869b1fe tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:08.091995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e461f056-a55d-4cae-9f01-7852c869b1fe tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:08.092679 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e461f056-a55d-4cae-9f01-7852c869b1fe tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:08.095814 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-0501686d-07d7-4431-bd8a-65e885366916 req-9c95bf6f-4789-4318-bffc-e76350189b49 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:08.096271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-0501686d-07d7-4431-bd8a-65e885366916 req-9c95bf6f-4789-4318-bffc-e76350189b49 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:08.111153 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-0501686d-07d7-4431-bd8a-65e885366916 req-9c95bf6f-4789-4318-bffc-e76350189b49 service nova] Creating event network-vif-plugged:cf1c50ae-e6c8-42f3-9333-a8eaf141bcd0 for instance 03f44195-49ec-496b-937e-eb9722a215c0 on hv-cinder-84980 Jul 14 11:46:08.116341 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-0501686d-07d7-4431-bd8a-65e885366916 req-9c95bf6f-4789-4318-bffc-e76350189b49 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039070 Jul 14 11:46:08.117047 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 87/210] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:46:08.241687 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e461f056-a55d-4cae-9f01-7852c869b1fe tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:08.249795 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-e461f056-a55d-4cae-9f01-7852c869b1fe tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1365 microversion: 2.1 time: 0.177165 Jul 14 11:46:08.250386 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 124/211] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:08 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:08.332535 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-7fec5b91-29d2-45d4-abe2-6818f3c57836 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:08.333271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-7fec5b91-29d2-45d4-abe2-6818f3c57836 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:08.339553 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7fec5b91-29d2-45d4-abe2-6818f3c57836 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:08.340564 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7fec5b91-29d2-45d4-abe2-6818f3c57836 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:08.341377 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7fec5b91-29d2-45d4-abe2-6818f3c57836 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:08.341817 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7fec5b91-29d2-45d4-abe2-6818f3c57836 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:08.566470 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-7fec5b91-29d2-45d4-abe2-6818f3c57836 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:08.571634 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-76d3ae6d-2c06-4f4e-b92b-ebd8bfeaea63 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:08.572484 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-76d3ae6d-2c06-4f4e-b92b-ebd8bfeaea63 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:08.576024 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-7fec5b91-29d2-45d4-abe2-6818f3c57836 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.247394 Jul 14 11:46:08.576837 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 88/212] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:08 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:08.581297 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-76d3ae6d-2c06-4f4e-b92b-ebd8bfeaea63 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:08.582072 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-76d3ae6d-2c06-4f4e-b92b-ebd8bfeaea63 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:08.583035 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-76d3ae6d-2c06-4f4e-b92b-ebd8bfeaea63 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:08.583614 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-76d3ae6d-2c06-4f4e-b92b-ebd8bfeaea63 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:08.724906 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-76d3ae6d-2c06-4f4e-b92b-ebd8bfeaea63 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:08.733069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-76d3ae6d-2c06-4f4e-b92b-ebd8bfeaea63 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1724 microversion: 2.1 time: 0.165211 Jul 14 11:46:08.733671 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 125/213] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:08 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:08.841295 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-7f376fc6-9eb7-48b1-bf26-9731f20942be req-5d12ade7-4b60-4d52-9119-3ba576651d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b863b39-54e7-4601-bb9b-d41e745f2e25", "tag": "1385e79d-6995-4f4e-8388-fd33d56039d8"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:46:08.852471 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-7f376fc6-9eb7-48b1-bf26-9731f20942be req-5d12ade7-4b60-4d52-9119-3ba576651d2a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:08.852920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-7f376fc6-9eb7-48b1-bf26-9731f20942be req-5d12ade7-4b60-4d52-9119-3ba576651d2a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:08.866034 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-7f376fc6-9eb7-48b1-bf26-9731f20942be req-5d12ade7-4b60-4d52-9119-3ba576651d2a service nova] Creating event network-changed:1385e79d-6995-4f4e-8388-fd33d56039d8 for instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 on hv-cinder-84980 Jul 14 11:46:08.871918 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-7f376fc6-9eb7-48b1-bf26-9731f20942be req-5d12ade7-4b60-4d52-9119-3ba576651d2a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033656 Jul 14 11:46:08.872554 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 89/214] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:46:08.959940 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-e56ce060-0f28-4f81-815c-6f56af8d426e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:08.960817 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-e56ce060-0f28-4f81-815c-6f56af8d426e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:08.967790 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e56ce060-0f28-4f81-815c-6f56af8d426e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:08.969901 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e56ce060-0f28-4f81-815c-6f56af8d426e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:08.970870 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e56ce060-0f28-4f81-815c-6f56af8d426e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:08.971463 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e56ce060-0f28-4f81-815c-6f56af8d426e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:09.114131 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e56ce060-0f28-4f81-815c-6f56af8d426e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:09.123027 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e56ce060-0f28-4f81-815c-6f56af8d426e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:09.124556 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e56ce060-0f28-4f81-815c-6f56af8d426e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:09.125764 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-e56ce060-0f28-4f81-815c-6f56af8d426e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1745 microversion: 2.20 time: 0.170018 Jul 14 11:46:09.126322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 126/215] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:08 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:09.267407 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-96ed4f71-16ef-40aa-9a5d-bf607b810637 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:09.269066 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-96ed4f71-16ef-40aa-9a5d-bf607b810637 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:09.275155 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96ed4f71-16ef-40aa-9a5d-bf607b810637 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:09.275620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96ed4f71-16ef-40aa-9a5d-bf607b810637 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:09.276262 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96ed4f71-16ef-40aa-9a5d-bf607b810637 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:09.276705 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96ed4f71-16ef-40aa-9a5d-bf607b810637 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:09.593589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-998f427c-1c57-4228-8cf8-628c41252ad0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:09.594204 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-998f427c-1c57-4228-8cf8-628c41252ad0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:09.600310 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-998f427c-1c57-4228-8cf8-628c41252ad0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:09.605898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-998f427c-1c57-4228-8cf8-628c41252ad0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:09.605898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-998f427c-1c57-4228-8cf8-628c41252ad0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:09.605898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-998f427c-1c57-4228-8cf8-628c41252ad0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:09.703985 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-96ed4f71-16ef-40aa-9a5d-bf607b810637 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:09.713056 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-96ed4f71-16ef-40aa-9a5d-bf607b810637 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1365 microversion: 2.1 time: 0.449929 Jul 14 11:46:09.720273 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 90/216] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:09 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1365 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:09.742263 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-998f427c-1c57-4228-8cf8-628c41252ad0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:09.751133 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-998f427c-1c57-4228-8cf8-628c41252ad0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.161767 Jul 14 11:46:09.752346 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b6bb79d5-b021-4d46-a173-67820a4fae7f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:09.753286 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b6bb79d5-b021-4d46-a173-67820a4fae7f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:09.757132 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 127/217] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:09 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:09.770582 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b6bb79d5-b021-4d46-a173-67820a4fae7f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:09.771384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b6bb79d5-b021-4d46-a173-67820a4fae7f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:09.772876 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b6bb79d5-b021-4d46-a173-67820a4fae7f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:09.773913 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b6bb79d5-b021-4d46-a173-67820a4fae7f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:10.034870 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b6bb79d5-b021-4d46-a173-67820a4fae7f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:10.049874 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b6bb79d5-b021-4d46-a173-67820a4fae7f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1724 microversion: 2.1 time: 0.302239 Jul 14 11:46:10.061173 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 91/218] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:09 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:10.144108 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-284559cb-1306-4aae-bf39-2f21c7225c79 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:10.144701 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-284559cb-1306-4aae-bf39-2f21c7225c79 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:10.152150 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-284559cb-1306-4aae-bf39-2f21c7225c79 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:10.153299 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-284559cb-1306-4aae-bf39-2f21c7225c79 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:10.154354 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-284559cb-1306-4aae-bf39-2f21c7225c79 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:10.154850 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-284559cb-1306-4aae-bf39-2f21c7225c79 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:10.290970 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-284559cb-1306-4aae-bf39-2f21c7225c79 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:10.298811 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-284559cb-1306-4aae-bf39-2f21c7225c79 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:10.300373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-284559cb-1306-4aae-bf39-2f21c7225c79 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:10.301567 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-284559cb-1306-4aae-bf39-2f21c7225c79 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1740 microversion: 2.20 time: 0.161617 Jul 14 11:46:10.302328 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 128/219] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:10 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:10.730671 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a087afd2-9c60-49fe-b2c8-054af31aa149 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:10.731289 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a087afd2-9c60-49fe-b2c8-054af31aa149 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:10.737412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a087afd2-9c60-49fe-b2c8-054af31aa149 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:10.737857 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a087afd2-9c60-49fe-b2c8-054af31aa149 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:10.738624 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a087afd2-9c60-49fe-b2c8-054af31aa149 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:10.739061 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a087afd2-9c60-49fe-b2c8-054af31aa149 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:10.768548 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-4a14c671-40ed-4d1b-83a2-50b0d84f3ac5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:10.769184 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-4a14c671-40ed-4d1b-83a2-50b0d84f3ac5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:10.775541 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4a14c671-40ed-4d1b-83a2-50b0d84f3ac5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:10.775981 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4a14c671-40ed-4d1b-83a2-50b0d84f3ac5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:10.776744 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4a14c671-40ed-4d1b-83a2-50b0d84f3ac5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:10.777466 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4a14c671-40ed-4d1b-83a2-50b0d84f3ac5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:10.879849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a087afd2-9c60-49fe-b2c8-054af31aa149 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:10.887726 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a087afd2-9c60-49fe-b2c8-054af31aa149 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1365 microversion: 2.1 time: 0.161594 Jul 14 11:46:10.888293 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 92/220] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:10 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:10.913387 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-4a14c671-40ed-4d1b-83a2-50b0d84f3ac5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:10.921693 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-4a14c671-40ed-4d1b-83a2-50b0d84f3ac5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.157131 Jul 14 11:46:10.922475 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 129/221] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:10 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:11.068571 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-1f6d7f87-fd4b-49fb-b6c7-7461a4f432fc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:11.070126 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-1f6d7f87-fd4b-49fb-b6c7-7461a4f432fc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:11.075659 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1f6d7f87-fd4b-49fb-b6c7-7461a4f432fc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:11.076161 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1f6d7f87-fd4b-49fb-b6c7-7461a4f432fc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:11.076877 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1f6d7f87-fd4b-49fb-b6c7-7461a4f432fc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:11.077347 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1f6d7f87-fd4b-49fb-b6c7-7461a4f432fc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:11.216489 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-1f6d7f87-fd4b-49fb-b6c7-7461a4f432fc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:11.226377 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-1f6d7f87-fd4b-49fb-b6c7-7461a4f432fc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1724 microversion: 2.1 time: 0.161576 Jul 14 11:46:11.226941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 93/222] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:11 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:11.320409 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-bf062fc3-87d0-466c-83ea-8e684fcb1089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:11.321206 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-bf062fc3-87d0-466c-83ea-8e684fcb1089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:11.328171 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bf062fc3-87d0-466c-83ea-8e684fcb1089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:11.328555 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bf062fc3-87d0-466c-83ea-8e684fcb1089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:11.329351 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bf062fc3-87d0-466c-83ea-8e684fcb1089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:11.329791 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bf062fc3-87d0-466c-83ea-8e684fcb1089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:11.480426 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-bf062fc3-87d0-466c-83ea-8e684fcb1089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:11.489959 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-bf062fc3-87d0-466c-83ea-8e684fcb1089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:11.491822 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-bf062fc3-87d0-466c-83ea-8e684fcb1089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:11.493577 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-bf062fc3-87d0-466c-83ea-8e684fcb1089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1740 microversion: 2.20 time: 0.177130 Jul 14 11:46:11.494943 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 130/223] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:11 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:11.904371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-451c6aab-5a4a-4301-bda1-89db81c16ec2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:11.905091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-451c6aab-5a4a-4301-bda1-89db81c16ec2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:11.912045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-451c6aab-5a4a-4301-bda1-89db81c16ec2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:11.912593 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-451c6aab-5a4a-4301-bda1-89db81c16ec2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:11.913563 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-451c6aab-5a4a-4301-bda1-89db81c16ec2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:11.914391 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-451c6aab-5a4a-4301-bda1-89db81c16ec2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:11.939089 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5c2e7b84-c657-410b-92f5-b1764e99a2cc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:11.939709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-5c2e7b84-c657-410b-92f5-b1764e99a2cc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:11.946213 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5c2e7b84-c657-410b-92f5-b1764e99a2cc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:11.946662 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5c2e7b84-c657-410b-92f5-b1764e99a2cc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:11.948539 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5c2e7b84-c657-410b-92f5-b1764e99a2cc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:11.948993 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5c2e7b84-c657-410b-92f5-b1764e99a2cc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:12.055290 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-451c6aab-5a4a-4301-bda1-89db81c16ec2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:12.073976 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-451c6aab-5a4a-4301-bda1-89db81c16ec2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1365 microversion: 2.1 time: 0.173351 Jul 14 11:46:12.094102 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 94/224] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:11 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:12.140503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-5c2e7b84-c657-410b-92f5-b1764e99a2cc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:12.158362 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-5c2e7b84-c657-410b-92f5-b1764e99a2cc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.223804 Jul 14 11:46:12.162684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 131/225] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:11 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:12.243657 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c205d858-5cc0-46ab-be73-087a41a18eee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:12.244292 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c205d858-5cc0-46ab-be73-087a41a18eee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:12.252196 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c205d858-5cc0-46ab-be73-087a41a18eee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:12.252944 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c205d858-5cc0-46ab-be73-087a41a18eee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:12.253947 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c205d858-5cc0-46ab-be73-087a41a18eee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:12.254589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c205d858-5cc0-46ab-be73-087a41a18eee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:12.399894 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-c205d858-5cc0-46ab-be73-087a41a18eee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:12.408170 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c205d858-5cc0-46ab-be73-087a41a18eee tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1724 microversion: 2.1 time: 0.168293 Jul 14 11:46:12.408734 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 95/226] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:12 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:12.513656 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6fbb467f-1803-440e-a3ea-9ce44e3bfe6d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:12.514704 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6fbb467f-1803-440e-a3ea-9ce44e3bfe6d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:12.522744 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6fbb467f-1803-440e-a3ea-9ce44e3bfe6d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:12.523196 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6fbb467f-1803-440e-a3ea-9ce44e3bfe6d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:12.524269 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6fbb467f-1803-440e-a3ea-9ce44e3bfe6d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:12.524887 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6fbb467f-1803-440e-a3ea-9ce44e3bfe6d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:12.679864 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6fbb467f-1803-440e-a3ea-9ce44e3bfe6d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:12.690268 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6fbb467f-1803-440e-a3ea-9ce44e3bfe6d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:12.692428 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6fbb467f-1803-440e-a3ea-9ce44e3bfe6d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:12.693933 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6fbb467f-1803-440e-a3ea-9ce44e3bfe6d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1740 microversion: 2.20 time: 0.184882 Jul 14 11:46:12.694830 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 132/227] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:12 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:13.098261 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-2328b409-de92-45a1-b1f1-fae0c94c8549 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:13.099714 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-2328b409-de92-45a1-b1f1-fae0c94c8549 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:13.109074 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2328b409-de92-45a1-b1f1-fae0c94c8549 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:13.109822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2328b409-de92-45a1-b1f1-fae0c94c8549 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:13.112454 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2328b409-de92-45a1-b1f1-fae0c94c8549 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:13.112454 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2328b409-de92-45a1-b1f1-fae0c94c8549 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:13.252334 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ca6810ac-618c-4e61-b42a-a45e9cc4a70d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:13.252334 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ca6810ac-618c-4e61-b42a-a45e9cc4a70d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:13.252334 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca6810ac-618c-4e61-b42a-a45e9cc4a70d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:13.252334 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca6810ac-618c-4e61-b42a-a45e9cc4a70d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:13.252896 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca6810ac-618c-4e61-b42a-a45e9cc4a70d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:13.252896 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca6810ac-618c-4e61-b42a-a45e9cc4a70d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:13.359619 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-2328b409-de92-45a1-b1f1-fae0c94c8549 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:13.367423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-2328b409-de92-45a1-b1f1-fae0c94c8549 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1365 microversion: 2.1 time: 0.271424 Jul 14 11:46:13.367423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 96/228] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:13 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:13.426731 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9b7e4017-fd65-4e67-8fc2-1f603adef29c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:13.427581 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9b7e4017-fd65-4e67-8fc2-1f603adef29c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:13.427914 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ca6810ac-618c-4e61-b42a-a45e9cc4a70d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:13.436011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9b7e4017-fd65-4e67-8fc2-1f603adef29c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:13.436527 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9b7e4017-fd65-4e67-8fc2-1f603adef29c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:13.437138 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ca6810ac-618c-4e61-b42a-a45e9cc4a70d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.263587 Jul 14 11:46:13.438067 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9b7e4017-fd65-4e67-8fc2-1f603adef29c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:13.438286 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 133/229] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:13 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:13.445817 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9b7e4017-fd65-4e67-8fc2-1f603adef29c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:13.607474 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9b7e4017-fd65-4e67-8fc2-1f603adef29c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:13.617758 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9b7e4017-fd65-4e67-8fc2-1f603adef29c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1724 microversion: 2.1 time: 0.195731 Jul 14 11:46:13.622506 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 97/230] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:13 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:13.713464 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f24aba3a-8477-4f9f-a52f-14bcd5b9c702 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:13.714920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f24aba3a-8477-4f9f-a52f-14bcd5b9c702 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:13.722735 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f24aba3a-8477-4f9f-a52f-14bcd5b9c702 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:13.723784 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f24aba3a-8477-4f9f-a52f-14bcd5b9c702 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:13.724878 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f24aba3a-8477-4f9f-a52f-14bcd5b9c702 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:13.725417 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f24aba3a-8477-4f9f-a52f-14bcd5b9c702 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:13.886898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f24aba3a-8477-4f9f-a52f-14bcd5b9c702 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:13.897791 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f24aba3a-8477-4f9f-a52f-14bcd5b9c702 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:13.901053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f24aba3a-8477-4f9f-a52f-14bcd5b9c702 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:13.902677 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f24aba3a-8477-4f9f-a52f-14bcd5b9c702 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1740 microversion: 2.20 time: 0.194230 Jul 14 11:46:13.913417 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 134/231] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:13 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:14.203192 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-6fbd7ca9-310a-4fd6-8b1e-870690ebbffd req-e98cdd47-40d9-4868-968e-3df8ad5d7d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b863b39-54e7-4601-bb9b-d41e745f2e25", "name": "network-vif-plugged", "status": "completed", "tag": "1385e79d-6995-4f4e-8388-fd33d56039d8"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:46:14.219010 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-6fbd7ca9-310a-4fd6-8b1e-870690ebbffd req-e98cdd47-40d9-4868-968e-3df8ad5d7d5a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:14.219529 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-6fbd7ca9-310a-4fd6-8b1e-870690ebbffd req-e98cdd47-40d9-4868-968e-3df8ad5d7d5a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:14.235856 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-6fbd7ca9-310a-4fd6-8b1e-870690ebbffd req-e98cdd47-40d9-4868-968e-3df8ad5d7d5a service nova] Creating event network-vif-plugged:1385e79d-6995-4f4e-8388-fd33d56039d8 for instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 on hv-cinder-84980 Jul 14 11:46:14.241046 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-6fbd7ca9-310a-4fd6-8b1e-870690ebbffd req-e98cdd47-40d9-4868-968e-3df8ad5d7d5a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042309 Jul 14 11:46:14.241924 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 98/232] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:46:14.323585 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1089116278", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-350530210", "security_groups": [{"name": "tempest-secgroup-smoke-2041065357"}], "networks": [{"uuid": "f77a597b-ab8a-49e2-9a1d-e420c995c2e6"}], "block_device_mapping_v2": [{"uuid": "979feae2-d68a-4238-90c7-021ffc773559", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:46:14.388721 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-937924da-07c8-4a7c-b64c-2446c66e3fec tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:14.389821 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-937924da-07c8-4a7c-b64c-2446c66e3fec tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:14.420482 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-937924da-07c8-4a7c-b64c-2446c66e3fec tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:14.421120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-937924da-07c8-4a7c-b64c-2446c66e3fec tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:14.431099 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-937924da-07c8-4a7c-b64c-2446c66e3fec tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:14.431652 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-937924da-07c8-4a7c-b64c-2446c66e3fec tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:14.445397 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=100 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:14.517046 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.network.neutron [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] validate_networks() for [('f77a597b-ab8a-49e2-9a1d-e420c995c2e6', None, None, None, None, None)] {{(pid=124947) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:46:14.621067 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:14.641514 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=6 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:14.705505 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-937924da-07c8-4a7c-b64c-2446c66e3fec tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:14.716524 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-937924da-07c8-4a7c-b64c-2446c66e3fec tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1365 microversion: 2.1 time: 0.335789 Jul 14 11:46:14.725797 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 99/233] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:14 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1365 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:14.725797 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-f5f297a6-7ff5-4611-afce-0494f5acba6c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:14.725797 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-f5f297a6-7ff5-4611-afce-0494f5acba6c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:14.731973 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f5f297a6-7ff5-4611-afce-0494f5acba6c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:14.732514 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f5f297a6-7ff5-4611-afce-0494f5acba6c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:14.733415 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f5f297a6-7ff5-4611-afce-0494f5acba6c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:14.743210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f5f297a6-7ff5-4611-afce-0494f5acba6c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:14.851794 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:14.946177 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f5f297a6-7ff5-4611-afce-0494f5acba6c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:14.954834 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-f5f297a6-7ff5-4611-afce-0494f5acba6c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.236101 Jul 14 11:46:14.955429 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 100/234] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:14 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:14.960099 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4e88e369-a67d-4e84-8292-383b4095fc26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:14.960791 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-4e88e369-a67d-4e84-8292-383b4095fc26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:14.967171 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4e88e369-a67d-4e84-8292-383b4095fc26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:14.967614 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4e88e369-a67d-4e84-8292-383b4095fc26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:14.968375 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4e88e369-a67d-4e84-8292-383b4095fc26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:14.968810 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4e88e369-a67d-4e84-8292-383b4095fc26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:15.017531 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Flavor limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:46:15.017957 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Image limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:46:15.018427 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Flavor pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:46:15.018864 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Image pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:46:15.019274 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:46:15.028794 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:15.029346 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:15.030157 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:15.030587 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:15.047811 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Getting quotas for project ca23768669a74586a221c14ebaa8ee26. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:46:15.051943 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Getting quotas for user d352cf5c00ae450c9a7ca4dcc68a87db and project ca23768669a74586a221c14ebaa8ee26. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:46:15.060854 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=100 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:15.113269 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Going to run 1 instances... {{(pid=124947) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:46:15.115628 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='979feae2-d68a-4238-90c7-021ffc773559',volume_size=None,volume_type=None)] {{(pid=124947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:46:15.123892 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-4e88e369-a67d-4e84-8292-383b4095fc26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:15.132161 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-4e88e369-a67d-4e84-8292-383b4095fc26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1701 microversion: 2.1 time: 0.175741 Jul 14 11:46:15.132735 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 101/235] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:14 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1701 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:15.137316 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ef71e8bc-3f31-4255-b11a-3a0f3e3aaa67 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:15.137924 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ef71e8bc-3f31-4255-b11a-3a0f3e3aaa67 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:15.147620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ef71e8bc-3f31-4255-b11a-3a0f3e3aaa67 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:15.148069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ef71e8bc-3f31-4255-b11a-3a0f3e3aaa67 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:15.148841 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ef71e8bc-3f31-4255-b11a-3a0f3e3aaa67 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:15.151191 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ef71e8bc-3f31-4255-b11a-3a0f3e3aaa67 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:15.302551 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ef71e8bc-3f31-4255-b11a-3a0f3e3aaa67 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:15.312548 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ef71e8bc-3f31-4255-b11a-3a0f3e3aaa67 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:15.315874 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ef71e8bc-3f31-4255-b11a-3a0f3e3aaa67 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:15.315874 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ef71e8bc-3f31-4255-b11a-3a0f3e3aaa67 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1740 microversion: 2.20 time: 0.181663 Jul 14 11:46:15.316162 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 102/236] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:15 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:15.320832 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-06ad86be-e512-45ed-a5fe-00731dee136d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:46:15.327788 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-06ad86be-e512-45ed-a5fe-00731dee136d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:15.328348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-06ad86be-e512-45ed-a5fe-00731dee136d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:15.396132 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-06ad86be-e512-45ed-a5fe-00731dee136d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Going to try to start instance {{(pid=124946) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 11:46:15.603893 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-41da7574-56c4-498e-aedc-ead0cd3213f2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.284435 Jul 14 11:46:15.613504 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 135/237] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:46:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:46:15.634960 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-06ad86be-e512-45ed-a5fe-00731dee136d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "POST /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/action" status: 202 len: 0 microversion: 2.1 time: 0.317491 Jul 14 11:46:15.639479 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 103/238] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 11:46:15 2022] POST /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:46:15.640939 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-458ff8a8-4d3e-4505-887b-7c188ba85c1d tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:15.641764 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-458ff8a8-4d3e-4505-887b-7c188ba85c1d tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:15.646607 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-f73e410b-5a6f-4524-9471-dbfe81820d1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:15.647346 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-f73e410b-5a6f-4524-9471-dbfe81820d1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:15.668058 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f73e410b-5a6f-4524-9471-dbfe81820d1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:15.668512 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f73e410b-5a6f-4524-9471-dbfe81820d1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:15.669352 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f73e410b-5a6f-4524-9471-dbfe81820d1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:15.669796 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f73e410b-5a6f-4524-9471-dbfe81820d1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:15.708947 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-458ff8a8-4d3e-4505-887b-7c188ba85c1d tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:15.724506 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-458ff8a8-4d3e-4505-887b-7c188ba85c1d tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1088 microversion: 2.1 time: 0.108094 Jul 14 11:46:15.724826 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 136/239] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:15 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1088 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:15.740716 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-bb4cef9b-b927-4f98-8a97-89dca202df15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:15.741651 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-bb4cef9b-b927-4f98-8a97-89dca202df15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:15.748850 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bb4cef9b-b927-4f98-8a97-89dca202df15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:15.749422 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bb4cef9b-b927-4f98-8a97-89dca202df15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:15.750348 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bb4cef9b-b927-4f98-8a97-89dca202df15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:15.750895 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bb4cef9b-b927-4f98-8a97-89dca202df15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:15.802827 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=100 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:15.885893 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f73e410b-5a6f-4524-9471-dbfe81820d1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:15.895921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-f73e410b-5a6f-4524-9471-dbfe81820d1b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1710 microversion: 2.1 time: 0.253497 Jul 14 11:46:15.896812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 104/240] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:15 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1710 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:15.971797 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-8cb1e3b0-edd7-41a9-a7bb-d6d8fd9ba4bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:15.985556 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-8cb1e3b0-edd7-41a9-a7bb-d6d8fd9ba4bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:15.985852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-bb4cef9b-b927-4f98-8a97-89dca202df15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:15.986346 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8cb1e3b0-edd7-41a9-a7bb-d6d8fd9ba4bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:15.986346 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8cb1e3b0-edd7-41a9-a7bb-d6d8fd9ba4bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:15.986346 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8cb1e3b0-edd7-41a9-a7bb-d6d8fd9ba4bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:15.986346 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8cb1e3b0-edd7-41a9-a7bb-d6d8fd9ba4bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:15.989441 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-bb4cef9b-b927-4f98-8a97-89dca202df15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1365 microversion: 2.1 time: 0.252634 Jul 14 11:46:15.998932 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 137/241] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:15 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:16.209187 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8cb1e3b0-edd7-41a9-a7bb-d6d8fd9ba4bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:16.219536 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-8cb1e3b0-edd7-41a9-a7bb-d6d8fd9ba4bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.251540 Jul 14 11:46:16.220640 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 105/242] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:15 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:16.335244 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c7e54c05-b2fe-44b0-8cac-80e8b2de473e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:16.336105 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c7e54c05-b2fe-44b0-8cac-80e8b2de473e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:16.345697 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c7e54c05-b2fe-44b0-8cac-80e8b2de473e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:16.346170 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c7e54c05-b2fe-44b0-8cac-80e8b2de473e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:16.346948 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c7e54c05-b2fe-44b0-8cac-80e8b2de473e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:16.347383 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c7e54c05-b2fe-44b0-8cac-80e8b2de473e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:16.546519 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c7e54c05-b2fe-44b0-8cac-80e8b2de473e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:16.561832 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c7e54c05-b2fe-44b0-8cac-80e8b2de473e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:16.563649 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c7e54c05-b2fe-44b0-8cac-80e8b2de473e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:16.565487 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c7e54c05-b2fe-44b0-8cac-80e8b2de473e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1740 microversion: 2.20 time: 0.234239 Jul 14 11:46:16.578631 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 138/243] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:16 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:16.744611 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4ff541ed-44ac-4556-ae2f-3c49d3826d94 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:16.745441 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-4ff541ed-44ac-4556-ae2f-3c49d3826d94 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:16.860449 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-4ff541ed-44ac-4556-ae2f-3c49d3826d94 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:16.869089 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-4ff541ed-44ac-4556-ae2f-3c49d3826d94 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1088 microversion: 2.1 time: 0.130924 Jul 14 11:46:16.879024 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 106/244] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:16 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1088 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:16.913567 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9347d8fe-7e6e-431b-a018-9cef21a2b225 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:16.914291 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9347d8fe-7e6e-431b-a018-9cef21a2b225 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:16.931798 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9347d8fe-7e6e-431b-a018-9cef21a2b225 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:16.932324 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9347d8fe-7e6e-431b-a018-9cef21a2b225 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:16.933379 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9347d8fe-7e6e-431b-a018-9cef21a2b225 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:16.934026 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9347d8fe-7e6e-431b-a018-9cef21a2b225 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:17.007590 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-011deab7-6966-485c-8e85-2a32b84284eb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:17.008234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-011deab7-6966-485c-8e85-2a32b84284eb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:17.023054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-011deab7-6966-485c-8e85-2a32b84284eb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:17.033977 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-011deab7-6966-485c-8e85-2a32b84284eb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:17.034831 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-011deab7-6966-485c-8e85-2a32b84284eb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:17.035278 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-011deab7-6966-485c-8e85-2a32b84284eb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:17.114193 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9347d8fe-7e6e-431b-a018-9cef21a2b225 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:17.123367 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9347d8fe-7e6e-431b-a018-9cef21a2b225 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1710 microversion: 2.1 time: 0.213761 Jul 14 11:46:17.134332 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 139/245] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:16 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1710 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:17.238726 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5a52c64a-2edb-4600-bc91-3e4d63a76e75 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:17.239344 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-5a52c64a-2edb-4600-bc91-3e4d63a76e75 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:17.252555 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5a52c64a-2edb-4600-bc91-3e4d63a76e75 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:17.253014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5a52c64a-2edb-4600-bc91-3e4d63a76e75 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:17.253857 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5a52c64a-2edb-4600-bc91-3e4d63a76e75 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:17.254298 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5a52c64a-2edb-4600-bc91-3e4d63a76e75 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:17.324162 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-011deab7-6966-485c-8e85-2a32b84284eb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:17.336460 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-011deab7-6966-485c-8e85-2a32b84284eb tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1556 microversion: 2.1 time: 0.332947 Jul 14 11:46:17.348148 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 107/246] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:17 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1556 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:17.355808 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-db30edff-5626-4316-87f2-e86a64fcba0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:17.365802 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-db30edff-5626-4316-87f2-e86a64fcba0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:17.365802 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-db30edff-5626-4316-87f2-e86a64fcba0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:17.365802 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-db30edff-5626-4316-87f2-e86a64fcba0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:17.367208 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-db30edff-5626-4316-87f2-e86a64fcba0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:17.368118 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-db30edff-5626-4316-87f2-e86a64fcba0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:17.463315 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-5a52c64a-2edb-4600-bc91-3e4d63a76e75 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:17.474164 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-5a52c64a-2edb-4600-bc91-3e4d63a76e75 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.239403 Jul 14 11:46:17.475351 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 140/247] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:17 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:17.587499 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3f0d98e8-b0dc-43c6-9833-16075c47b067 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:17.589008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3f0d98e8-b0dc-43c6-9833-16075c47b067 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:17.603866 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3f0d98e8-b0dc-43c6-9833-16075c47b067 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:17.604649 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3f0d98e8-b0dc-43c6-9833-16075c47b067 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:17.605761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3f0d98e8-b0dc-43c6-9833-16075c47b067 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:17.607362 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3f0d98e8-b0dc-43c6-9833-16075c47b067 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:17.679580 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-db30edff-5626-4316-87f2-e86a64fcba0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.328852 Jul 14 11:46:17.680203 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 108/248] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jul 14 11:46:17 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25/os-interface => generated 285 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:46:17.775834 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3f0d98e8-b0dc-43c6-9833-16075c47b067 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:17.789876 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3f0d98e8-b0dc-43c6-9833-16075c47b067 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:17.789876 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3f0d98e8-b0dc-43c6-9833-16075c47b067 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:17.790457 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3f0d98e8-b0dc-43c6-9833-16075c47b067 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1740 microversion: 2.20 time: 0.209917 Jul 14 11:46:17.802696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 141/249] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:17 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:17.886365 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ac8ce526-3378-4084-87a0-7e00ef20eeed tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:17.886990 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ac8ce526-3378-4084-87a0-7e00ef20eeed tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:17.895584 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ac8ce526-3378-4084-87a0-7e00ef20eeed tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:17.896038 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ac8ce526-3378-4084-87a0-7e00ef20eeed tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:17.896817 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ac8ce526-3378-4084-87a0-7e00ef20eeed tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:17.897284 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ac8ce526-3378-4084-87a0-7e00ef20eeed tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:17.997413 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ac8ce526-3378-4084-87a0-7e00ef20eeed tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:18.018288 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ac8ce526-3378-4084-87a0-7e00ef20eeed tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1186 microversion: 2.1 time: 0.136110 Jul 14 11:46:18.019542 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 109/250] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:17 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1186 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:18.143275 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f5ad0a8b-5a53-469a-ba48-9995abd4bc0e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:18.144185 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f5ad0a8b-5a53-469a-ba48-9995abd4bc0e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:18.151308 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f5ad0a8b-5a53-469a-ba48-9995abd4bc0e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:18.156123 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f5ad0a8b-5a53-469a-ba48-9995abd4bc0e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:18.161016 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f5ad0a8b-5a53-469a-ba48-9995abd4bc0e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:18.161016 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f5ad0a8b-5a53-469a-ba48-9995abd4bc0e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:18.417534 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f5ad0a8b-5a53-469a-ba48-9995abd4bc0e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:18.431501 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f5ad0a8b-5a53-469a-ba48-9995abd4bc0e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1710 microversion: 2.1 time: 0.292714 Jul 14 11:46:18.432445 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 142/251] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:18 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1710 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:18.492116 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c67a2077-635f-46e8-9f72-28b5dbfc1d24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:18.492748 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c67a2077-635f-46e8-9f72-28b5dbfc1d24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:18.501202 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c67a2077-635f-46e8-9f72-28b5dbfc1d24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:18.501202 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c67a2077-635f-46e8-9f72-28b5dbfc1d24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:18.501202 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c67a2077-635f-46e8-9f72-28b5dbfc1d24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:18.501661 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c67a2077-635f-46e8-9f72-28b5dbfc1d24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:18.809882 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2dc6bf49-959f-4c81-a228-eb251913afb3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:18.810510 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2dc6bf49-959f-4c81-a228-eb251913afb3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:18.816844 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2dc6bf49-959f-4c81-a228-eb251913afb3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:18.817345 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2dc6bf49-959f-4c81-a228-eb251913afb3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:18.818127 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2dc6bf49-959f-4c81-a228-eb251913afb3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:18.818565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2dc6bf49-959f-4c81-a228-eb251913afb3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:18.936128 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-c67a2077-635f-46e8-9f72-28b5dbfc1d24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:18.936128 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c67a2077-635f-46e8-9f72-28b5dbfc1d24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.441028 Jul 14 11:46:18.936128 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 110/252] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:18 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:18.976401 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2dc6bf49-959f-4c81-a228-eb251913afb3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:18.984414 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2dc6bf49-959f-4c81-a228-eb251913afb3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:18.985954 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2dc6bf49-959f-4c81-a228-eb251913afb3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:18.987098 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2dc6bf49-959f-4c81-a228-eb251913afb3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1740 microversion: 2.20 time: 0.181441 Jul 14 11:46:18.987651 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 143/253] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:18 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:46:19.037582 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a0f04b2a-dcbc-44ad-a289-4631e13c4e6f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:19.038195 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a0f04b2a-dcbc-44ad-a289-4631e13c4e6f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:19.044185 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a0f04b2a-dcbc-44ad-a289-4631e13c4e6f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:19.044630 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a0f04b2a-dcbc-44ad-a289-4631e13c4e6f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:19.045401 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a0f04b2a-dcbc-44ad-a289-4631e13c4e6f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:19.045830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a0f04b2a-dcbc-44ad-a289-4631e13c4e6f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:19.112934 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a0f04b2a-dcbc-44ad-a289-4631e13c4e6f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:19.121481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a0f04b2a-dcbc-44ad-a289-4631e13c4e6f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1186 microversion: 2.1 time: 0.087713 Jul 14 11:46:19.122547 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 111/254] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:19 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:19.450579 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8fa0945d-291f-4b90-827d-3e9e0244f6da tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:19.451176 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-8fa0945d-291f-4b90-827d-3e9e0244f6da tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:19.458109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8fa0945d-291f-4b90-827d-3e9e0244f6da tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:19.458861 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8fa0945d-291f-4b90-827d-3e9e0244f6da tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:19.459625 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8fa0945d-291f-4b90-827d-3e9e0244f6da tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:19.460230 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8fa0945d-291f-4b90-827d-3e9e0244f6da tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:19.643419 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-8fa0945d-291f-4b90-827d-3e9e0244f6da tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:19.657282 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-8fa0945d-291f-4b90-827d-3e9e0244f6da tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1714 microversion: 2.1 time: 0.206527 Jul 14 11:46:19.666128 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 144/255] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:19 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1714 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:19.949679 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-cf12336e-9133-4067-9ec0-5db528e55b9f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:19.951045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-cf12336e-9133-4067-9ec0-5db528e55b9f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:19.958798 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cf12336e-9133-4067-9ec0-5db528e55b9f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:19.959387 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cf12336e-9133-4067-9ec0-5db528e55b9f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:19.962591 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cf12336e-9133-4067-9ec0-5db528e55b9f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:19.963309 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cf12336e-9133-4067-9ec0-5db528e55b9f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:20.007047 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-af043340-085a-465a-82f8-cce283308070 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:20.009377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-af043340-085a-465a-82f8-cce283308070 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:20.048743 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-af043340-085a-465a-82f8-cce283308070 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:20.051050 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-af043340-085a-465a-82f8-cce283308070 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:20.051050 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-af043340-085a-465a-82f8-cce283308070 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:20.051050 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-af043340-085a-465a-82f8-cce283308070 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:20.286313 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-cf12336e-9133-4067-9ec0-5db528e55b9f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:20.291887 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-af043340-085a-465a-82f8-cce283308070 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:20.296236 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-cf12336e-9133-4067-9ec0-5db528e55b9f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.349992 Jul 14 11:46:20.296423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 112/256] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:19 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:20.302138 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-af043340-085a-465a-82f8-cce283308070 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:20.304018 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-af043340-085a-465a-82f8-cce283308070 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:20.305306 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-af043340-085a-465a-82f8-cce283308070 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1740 microversion: 2.20 time: 0.303674 Jul 14 11:46:20.306152 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 145/257] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:20 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:46:20.311476 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-6cb9b338-22bf-4901-8727-cc41a2bbf218 req-1c9018f6-8b32-4960-bd2e-bafd5a8e033d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b863b39-54e7-4601-bb9b-d41e745f2e25", "tag": "1385e79d-6995-4f4e-8388-fd33d56039d8"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:46:20.318057 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-bafec6bc-2245-4cd5-9219-3c2c2f65b297 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:20.319186 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-bafec6bc-2245-4cd5-9219-3c2c2f65b297 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:20.320367 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-6cb9b338-22bf-4901-8727-cc41a2bbf218 req-1c9018f6-8b32-4960-bd2e-bafd5a8e033d service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:20.320900 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-6cb9b338-22bf-4901-8727-cc41a2bbf218 req-1c9018f6-8b32-4960-bd2e-bafd5a8e033d service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:20.330031 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bafec6bc-2245-4cd5-9219-3c2c2f65b297 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:20.330480 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bafec6bc-2245-4cd5-9219-3c2c2f65b297 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:20.331256 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bafec6bc-2245-4cd5-9219-3c2c2f65b297 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:20.331687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bafec6bc-2245-4cd5-9219-3c2c2f65b297 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:20.336882 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-6cb9b338-22bf-4901-8727-cc41a2bbf218 req-1c9018f6-8b32-4960-bd2e-bafd5a8e033d service nova] Creating event network-changed:1385e79d-6995-4f4e-8388-fd33d56039d8 for instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 on hv-cinder-84980 Jul 14 11:46:20.343631 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-6cb9b338-22bf-4901-8727-cc41a2bbf218 req-1c9018f6-8b32-4960-bd2e-bafd5a8e033d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035668 Jul 14 11:46:20.350535 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 146/258] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:46:20.441476 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-bafec6bc-2245-4cd5-9219-3c2c2f65b297 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:20.455680 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-bafec6bc-2245-4cd5-9219-3c2c2f65b297 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1204 microversion: 2.1 time: 0.158121 Jul 14 11:46:20.456802 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 113/259] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:20 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1204 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:21.312617 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7fc7a0d0-fe6f-48cf-b88b-75c56458d947 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:21.313424 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7fc7a0d0-fe6f-48cf-b88b-75c56458d947 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:21.322269 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7fc7a0d0-fe6f-48cf-b88b-75c56458d947 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:21.324677 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7fc7a0d0-fe6f-48cf-b88b-75c56458d947 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:21.324677 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7fc7a0d0-fe6f-48cf-b88b-75c56458d947 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:21.324677 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7fc7a0d0-fe6f-48cf-b88b-75c56458d947 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:21.328985 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-15a163c4-9f9b-4c53-979f-da01fa758149 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:21.330362 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-15a163c4-9f9b-4c53-979f-da01fa758149 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:21.340149 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-15a163c4-9f9b-4c53-979f-da01fa758149 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:21.345824 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-15a163c4-9f9b-4c53-979f-da01fa758149 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:21.347055 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-15a163c4-9f9b-4c53-979f-da01fa758149 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:21.348237 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-15a163c4-9f9b-4c53-979f-da01fa758149 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:21.529444 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7fc7a0d0-fe6f-48cf-b88b-75c56458d947 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:21.542421 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7fc7a0d0-fe6f-48cf-b88b-75c56458d947 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.233887 Jul 14 11:46:21.543119 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 147/260] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:21 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:21.547928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-02af908a-4218-497a-bf50-0f5bc07648d2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:21.553046 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-02af908a-4218-497a-bf50-0f5bc07648d2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:21.566526 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-15a163c4-9f9b-4c53-979f-da01fa758149 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:21.570316 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-02af908a-4218-497a-bf50-0f5bc07648d2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:21.570875 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-02af908a-4218-497a-bf50-0f5bc07648d2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:21.572448 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-02af908a-4218-497a-bf50-0f5bc07648d2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:21.572969 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-02af908a-4218-497a-bf50-0f5bc07648d2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:21.581793 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-15a163c4-9f9b-4c53-979f-da01fa758149 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:21.583538 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-15a163c4-9f9b-4c53-979f-da01fa758149 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:21.584962 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-15a163c4-9f9b-4c53-979f-da01fa758149 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1740 microversion: 2.20 time: 0.265063 Jul 14 11:46:21.586077 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 114/261] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:21 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:46:21.774937 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-02af908a-4218-497a-bf50-0f5bc07648d2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:21.783597 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-02af908a-4218-497a-bf50-0f5bc07648d2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1272 microversion: 2.1 time: 0.239339 Jul 14 11:46:21.784916 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 148/262] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:21 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:22.560303 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a6b3d3b3-7df3-4845-8348-8b372ae5a06c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:22.560943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a6b3d3b3-7df3-4845-8348-8b372ae5a06c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:22.567797 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a6b3d3b3-7df3-4845-8348-8b372ae5a06c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:22.568325 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a6b3d3b3-7df3-4845-8348-8b372ae5a06c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:22.569646 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a6b3d3b3-7df3-4845-8348-8b372ae5a06c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:22.570423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a6b3d3b3-7df3-4845-8348-8b372ae5a06c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:22.602708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-cf631199-1ff8-405f-8883-0cced8c28d90 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:22.603314 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-cf631199-1ff8-405f-8883-0cced8c28d90 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:22.610274 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cf631199-1ff8-405f-8883-0cced8c28d90 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:22.610725 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cf631199-1ff8-405f-8883-0cced8c28d90 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:22.611518 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cf631199-1ff8-405f-8883-0cced8c28d90 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:22.612002 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cf631199-1ff8-405f-8883-0cced8c28d90 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:22.749949 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-cf631199-1ff8-405f-8883-0cced8c28d90 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:22.758531 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-cf631199-1ff8-405f-8883-0cced8c28d90 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:22.760088 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-cf631199-1ff8-405f-8883-0cced8c28d90 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:22.761309 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-cf631199-1ff8-405f-8883-0cced8c28d90 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1740 microversion: 2.20 time: 0.162522 Jul 14 11:46:22.761879 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 149/263] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:22 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:46:22.805217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-83217bd8-3927-4df1-8ea6-5f18d38c9495 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:22.806340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-83217bd8-3927-4df1-8ea6-5f18d38c9495 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:22.815260 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-83217bd8-3927-4df1-8ea6-5f18d38c9495 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:22.815818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-83217bd8-3927-4df1-8ea6-5f18d38c9495 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:22.816715 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-83217bd8-3927-4df1-8ea6-5f18d38c9495 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:22.817256 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-83217bd8-3927-4df1-8ea6-5f18d38c9495 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:22.958652 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-83217bd8-3927-4df1-8ea6-5f18d38c9495 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:22.968142 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-83217bd8-3927-4df1-8ea6-5f18d38c9495 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1272 microversion: 2.1 time: 0.170140 Jul 14 11:46:22.968946 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 150/264] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:22 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:23.116921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a6b3d3b3-7df3-4845-8348-8b372ae5a06c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:23.125104 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a6b3d3b3-7df3-4845-8348-8b372ae5a06c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.569173 Jul 14 11:46:23.125811 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 115/265] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:22 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:23.780645 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ca73f0f2-5c8c-4900-8648-2f135ed1ee73 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:23.781530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ca73f0f2-5c8c-4900-8648-2f135ed1ee73 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:23.788870 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca73f0f2-5c8c-4900-8648-2f135ed1ee73 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:23.796350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca73f0f2-5c8c-4900-8648-2f135ed1ee73 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:23.798512 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca73f0f2-5c8c-4900-8648-2f135ed1ee73 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:23.800211 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca73f0f2-5c8c-4900-8648-2f135ed1ee73 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:23.973482 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-8d60aa46-8511-4e9f-a44c-6afdf0fe9420 req-ddb0de6f-bd1a-4c2d-95cf-559c810bba8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee797cbe-7b7e-4e87-9da7-0c628ae3ede1", "tag": "df04a441-a4c9-485f-845a-68acb74d2d4e"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:46:23.989312 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-8d60aa46-8511-4e9f-a44c-6afdf0fe9420 req-ddb0de6f-bd1a-4c2d-95cf-559c810bba8f service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:23.990612 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-8d60aa46-8511-4e9f-a44c-6afdf0fe9420 req-ddb0de6f-bd1a-4c2d-95cf-559c810bba8f service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:24.001757 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:24.013467 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-8d60aa46-8511-4e9f-a44c-6afdf0fe9420 req-ddb0de6f-bd1a-4c2d-95cf-559c810bba8f service nova] Creating event network-changed:df04a441-a4c9-485f-845a-68acb74d2d4e for instance ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 on hv-cinder-84980 Jul 14 11:46:24.022726 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-8d60aa46-8511-4e9f-a44c-6afdf0fe9420 req-ddb0de6f-bd1a-4c2d-95cf-559c810bba8f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054287 Jul 14 11:46:24.022726 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 116/266] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:46:24.027252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ca73f0f2-5c8c-4900-8648-2f135ed1ee73 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:24.038374 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-0d299cd2-8a2f-4543-9d66-a1de45dd516b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:24.041432 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ca73f0f2-5c8c-4900-8648-2f135ed1ee73 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:24.042462 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-0d299cd2-8a2f-4543-9d66-a1de45dd516b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:24.045968 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ca73f0f2-5c8c-4900-8648-2f135ed1ee73 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:24.048664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ca73f0f2-5c8c-4900-8648-2f135ed1ee73 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1740 microversion: 2.20 time: 0.272403 Jul 14 11:46:24.050315 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 151/267] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:23 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:24.055285 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0d299cd2-8a2f-4543-9d66-a1de45dd516b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:24.055935 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0d299cd2-8a2f-4543-9d66-a1de45dd516b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:24.056949 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0d299cd2-8a2f-4543-9d66-a1de45dd516b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:24.057568 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0d299cd2-8a2f-4543-9d66-a1de45dd516b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:24.146159 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7902d0c2-e1cf-45a8-908f-fc5e81f78fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:24.146777 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7902d0c2-e1cf-45a8-908f-fc5e81f78fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:24.153964 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7902d0c2-e1cf-45a8-908f-fc5e81f78fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:24.154655 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7902d0c2-e1cf-45a8-908f-fc5e81f78fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:24.155742 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7902d0c2-e1cf-45a8-908f-fc5e81f78fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:24.156378 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7902d0c2-e1cf-45a8-908f-fc5e81f78fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:24.294422 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-0d299cd2-8a2f-4543-9d66-a1de45dd516b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:24.302337 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-0d299cd2-8a2f-4543-9d66-a1de45dd516b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1272 microversion: 2.1 time: 0.278908 Jul 14 11:46:24.303357 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 117/268] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:24 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1272 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:24.311355 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7902d0c2-e1cf-45a8-908f-fc5e81f78fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:24.327222 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7902d0c2-e1cf-45a8-908f-fc5e81f78fe8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.184280 Jul 14 11:46:24.327731 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 152/269] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:24 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:25.069640 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-dcba86a3-02e9-4d32-b193-59cc4b5c7232 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:25.070287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-dcba86a3-02e9-4d32-b193-59cc4b5c7232 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:25.077714 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dcba86a3-02e9-4d32-b193-59cc4b5c7232 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:25.078177 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dcba86a3-02e9-4d32-b193-59cc4b5c7232 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:25.078938 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dcba86a3-02e9-4d32-b193-59cc4b5c7232 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:25.079375 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dcba86a3-02e9-4d32-b193-59cc4b5c7232 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:25.224025 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-dcba86a3-02e9-4d32-b193-59cc4b5c7232 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:25.232588 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-dcba86a3-02e9-4d32-b193-59cc4b5c7232 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:25.234148 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-dcba86a3-02e9-4d32-b193-59cc4b5c7232 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:25.235328 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-dcba86a3-02e9-4d32-b193-59cc4b5c7232 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1740 microversion: 2.20 time: 0.169790 Jul 14 11:46:25.235889 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 118/270] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:25 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:25.319891 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-604811ed-28e8-4b97-8ca1-8535442718c7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:25.320431 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-604811ed-28e8-4b97-8ca1-8535442718c7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:25.322602 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:25.327554 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-604811ed-28e8-4b97-8ca1-8535442718c7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:25.328001 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-604811ed-28e8-4b97-8ca1-8535442718c7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:25.328767 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-604811ed-28e8-4b97-8ca1-8535442718c7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:25.329227 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-604811ed-28e8-4b97-8ca1-8535442718c7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:25.344181 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e2eca3d3-672c-4428-901e-c3eda7da61c0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:25.344798 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e2eca3d3-672c-4428-901e-c3eda7da61c0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:25.351778 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e2eca3d3-672c-4428-901e-c3eda7da61c0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:25.352237 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e2eca3d3-672c-4428-901e-c3eda7da61c0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:25.353120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e2eca3d3-672c-4428-901e-c3eda7da61c0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:25.353513 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e2eca3d3-672c-4428-901e-c3eda7da61c0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:25.470798 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-604811ed-28e8-4b97-8ca1-8535442718c7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:25.478335 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-604811ed-28e8-4b97-8ca1-8535442718c7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.162663 Jul 14 11:46:25.479193 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 153/271] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:25 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:25.487190 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e2eca3d3-672c-4428-901e-c3eda7da61c0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:25.495413 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e2eca3d3-672c-4428-901e-c3eda7da61c0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.155593 Jul 14 11:46:25.496101 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 119/272] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:25 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:26.253939 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7fd7db4c-1b0b-4e04-9450-9c183609f089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:26.254551 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7fd7db4c-1b0b-4e04-9450-9c183609f089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:26.256453 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=8 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:26.261483 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7fd7db4c-1b0b-4e04-9450-9c183609f089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:26.261955 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7fd7db4c-1b0b-4e04-9450-9c183609f089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:26.265233 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7fd7db4c-1b0b-4e04-9450-9c183609f089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:26.265696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7fd7db4c-1b0b-4e04-9450-9c183609f089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:26.406127 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7fd7db4c-1b0b-4e04-9450-9c183609f089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:26.409645 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=100 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:26.414576 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7fd7db4c-1b0b-4e04-9450-9c183609f089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:26.416106 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7fd7db4c-1b0b-4e04-9450-9c183609f089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:26.417295 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7fd7db4c-1b0b-4e04-9450-9c183609f089 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1722 microversion: 2.20 time: 0.167446 Jul 14 11:46:26.421182 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 154/273] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:26 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:26.496347 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-75db683e-39a6-47e4-a080-107c81b1e57b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:26.496967 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-75db683e-39a6-47e4-a080-107c81b1e57b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:26.503661 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-75db683e-39a6-47e4-a080-107c81b1e57b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:26.504110 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-75db683e-39a6-47e4-a080-107c81b1e57b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:26.504886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-75db683e-39a6-47e4-a080-107c81b1e57b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:26.505356 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-75db683e-39a6-47e4-a080-107c81b1e57b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:26.511812 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-cebdcc8f-b985-461b-bd10-e47cba241079 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:26.513960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-cebdcc8f-b985-461b-bd10-e47cba241079 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:26.519429 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cebdcc8f-b985-461b-bd10-e47cba241079 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:26.519881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cebdcc8f-b985-461b-bd10-e47cba241079 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:26.520675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cebdcc8f-b985-461b-bd10-e47cba241079 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:26.521115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cebdcc8f-b985-461b-bd10-e47cba241079 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:26.652135 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-75db683e-39a6-47e4-a080-107c81b1e57b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:26.664196 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-cebdcc8f-b985-461b-bd10-e47cba241079 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:26.666861 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-75db683e-39a6-47e4-a080-107c81b1e57b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.174779 Jul 14 11:46:26.667597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 120/274] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:26 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:26.673179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-cebdcc8f-b985-461b-bd10-e47cba241079 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.164466 Jul 14 11:46:26.673179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 155/275] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:26 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:27.435251 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f2981171-76d2-4b15-9800-6eb783101238 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:27.435856 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f2981171-76d2-4b15-9800-6eb783101238 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:27.443364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f2981171-76d2-4b15-9800-6eb783101238 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:27.445546 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f2981171-76d2-4b15-9800-6eb783101238 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:27.445546 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f2981171-76d2-4b15-9800-6eb783101238 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:27.445546 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f2981171-76d2-4b15-9800-6eb783101238 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:27.576261 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f2981171-76d2-4b15-9800-6eb783101238 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:27.584168 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f2981171-76d2-4b15-9800-6eb783101238 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:27.585711 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f2981171-76d2-4b15-9800-6eb783101238 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:27.586864 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f2981171-76d2-4b15-9800-6eb783101238 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1722 microversion: 2.20 time: 0.155841 Jul 14 11:46:27.587467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 156/276] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:27 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:27.685244 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3ba3af50-c9cd-401c-9771-cb0fcf8ec19d tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:27.685879 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3ba3af50-c9cd-401c-9771-cb0fcf8ec19d tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:27.688177 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:27.688815 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9957e10f-a643-435c-a8e7-ab941bd229db tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:27.689471 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9957e10f-a643-435c-a8e7-ab941bd229db tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:27.693417 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:27.696447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3ba3af50-c9cd-401c-9771-cb0fcf8ec19d tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:27.696447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3ba3af50-c9cd-401c-9771-cb0fcf8ec19d tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:27.696666 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9957e10f-a643-435c-a8e7-ab941bd229db tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:27.696666 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9957e10f-a643-435c-a8e7-ab941bd229db tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:27.697030 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3ba3af50-c9cd-401c-9771-cb0fcf8ec19d tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:27.697245 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9957e10f-a643-435c-a8e7-ab941bd229db tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:27.697688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9957e10f-a643-435c-a8e7-ab941bd229db tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:27.698264 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3ba3af50-c9cd-401c-9771-cb0fcf8ec19d tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:27.859257 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9957e10f-a643-435c-a8e7-ab941bd229db tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:27.865352 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-3ba3af50-c9cd-401c-9771-cb0fcf8ec19d tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:27.867385 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9957e10f-a643-435c-a8e7-ab941bd229db tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.182514 Jul 14 11:46:27.868004 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 157/277] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:27 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:27.873669 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3ba3af50-c9cd-401c-9771-cb0fcf8ec19d tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.193230 Jul 14 11:46:27.875106 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 121/278] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:27 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:28.420161 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-3634d237-7234-46e1-85f0-3027f84e3c99 req-070f0fd3-80a7-49d4-a20f-066aeca3ea9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f44195-49ec-496b-937e-eb9722a215c0", "name": "network-vif-unplugged", "status": "completed", "tag": "cf1c50ae-e6c8-42f3-9333-a8eaf141bcd0"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:46:28.428705 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-3634d237-7234-46e1-85f0-3027f84e3c99 req-070f0fd3-80a7-49d4-a20f-066aeca3ea9a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:28.429142 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-3634d237-7234-46e1-85f0-3027f84e3c99 req-070f0fd3-80a7-49d4-a20f-066aeca3ea9a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:28.440928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-3634d237-7234-46e1-85f0-3027f84e3c99 req-070f0fd3-80a7-49d4-a20f-066aeca3ea9a service nova] Creating event network-vif-unplugged:cf1c50ae-e6c8-42f3-9333-a8eaf141bcd0 for instance 03f44195-49ec-496b-937e-eb9722a215c0 on hv-cinder-84980 Jul 14 11:46:28.446052 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-3634d237-7234-46e1-85f0-3027f84e3c99 req-070f0fd3-80a7-49d4-a20f-066aeca3ea9a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029753 Jul 14 11:46:28.446635 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 158/279] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:46:28.605765 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c61a3d48-4e49-4086-b2ed-ede052ef23be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:28.606889 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c61a3d48-4e49-4086-b2ed-ede052ef23be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:28.612919 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c61a3d48-4e49-4086-b2ed-ede052ef23be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:28.613410 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c61a3d48-4e49-4086-b2ed-ede052ef23be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:28.614181 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c61a3d48-4e49-4086-b2ed-ede052ef23be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:28.614620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c61a3d48-4e49-4086-b2ed-ede052ef23be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:28.746280 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-c61a3d48-4e49-4086-b2ed-ede052ef23be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:28.755276 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-c61a3d48-4e49-4086-b2ed-ede052ef23be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:28.756817 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-c61a3d48-4e49-4086-b2ed-ede052ef23be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:28.758030 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c61a3d48-4e49-4086-b2ed-ede052ef23be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1722 microversion: 2.20 time: 0.156671 Jul 14 11:46:28.758583 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 122/280] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:28 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:28.884453 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b8d4a4e4-84b2-4bc0-bad2-206b30432557 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:28.885290 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b8d4a4e4-84b2-4bc0-bad2-206b30432557 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:28.891383 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-55e80332-613d-4e78-b8ce-ea875163d749 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:28.891994 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-55e80332-613d-4e78-b8ce-ea875163d749 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:28.892198 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b8d4a4e4-84b2-4bc0-bad2-206b30432557 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:28.892625 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b8d4a4e4-84b2-4bc0-bad2-206b30432557 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:28.893417 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b8d4a4e4-84b2-4bc0-bad2-206b30432557 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:28.893847 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b8d4a4e4-84b2-4bc0-bad2-206b30432557 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:28.897964 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-55e80332-613d-4e78-b8ce-ea875163d749 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:28.898408 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-55e80332-613d-4e78-b8ce-ea875163d749 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:28.899436 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-55e80332-613d-4e78-b8ce-ea875163d749 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:28.899862 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-55e80332-613d-4e78-b8ce-ea875163d749 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:29.031229 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b8d4a4e4-84b2-4bc0-bad2-206b30432557 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:29.032557 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-55e80332-613d-4e78-b8ce-ea875163d749 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:29.039787 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b8d4a4e4-84b2-4bc0-bad2-206b30432557 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.159489 Jul 14 11:46:29.045736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-55e80332-613d-4e78-b8ce-ea875163d749 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.153267 Jul 14 11:46:29.045862 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 159/281] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:28 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:29.045952 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 123/282] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:28 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:29.784797 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-64431b6a-3a7e-4a15-8852-63f9bcde91ab tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:29.785434 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-64431b6a-3a7e-4a15-8852-63f9bcde91ab tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:29.791470 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-64431b6a-3a7e-4a15-8852-63f9bcde91ab tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:29.791924 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-64431b6a-3a7e-4a15-8852-63f9bcde91ab tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:29.792680 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-64431b6a-3a7e-4a15-8852-63f9bcde91ab tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:29.793114 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-64431b6a-3a7e-4a15-8852-63f9bcde91ab tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:29.958774 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-64431b6a-3a7e-4a15-8852-63f9bcde91ab tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:29.966761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-64431b6a-3a7e-4a15-8852-63f9bcde91ab tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:29.968268 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-64431b6a-3a7e-4a15-8852-63f9bcde91ab tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:29.969465 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-64431b6a-3a7e-4a15-8852-63f9bcde91ab tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1725 microversion: 2.20 time: 0.188530 Jul 14 11:46:29.970015 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 160/283] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:29 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:29.987183 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-42a188d0-6224-4997-b2b8-3b40fae8bd0f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d795e08-02e9-4806-8318-00afb9081e45"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:46:29.988300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-42a188d0-6224-4997-b2b8-3b40fae8bd0f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:29.994944 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-42a188d0-6224-4997-b2b8-3b40fae8bd0f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:29.995416 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-42a188d0-6224-4997-b2b8-3b40fae8bd0f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:29.996157 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-42a188d0-6224-4997-b2b8-3b40fae8bd0f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:29.997101 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-42a188d0-6224-4997-b2b8-3b40fae8bd0f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:30.056903 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-777a8401-1e18-4b27-8b36-1314bcff8883 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:30.057741 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-777a8401-1e18-4b27-8b36-1314bcff8883 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:30.065201 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-777a8401-1e18-4b27-8b36-1314bcff8883 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:30.067227 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-777a8401-1e18-4b27-8b36-1314bcff8883 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:30.068042 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-777a8401-1e18-4b27-8b36-1314bcff8883 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:30.068582 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-777a8401-1e18-4b27-8b36-1314bcff8883 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:30.212470 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-777a8401-1e18-4b27-8b36-1314bcff8883 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:30.220277 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-777a8401-1e18-4b27-8b36-1314bcff8883 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1522 microversion: 2.1 time: 0.167051 Jul 14 11:46:30.221064 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 161/284] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:30 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:30.226528 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f1cbca58-a983-4ae8-b9a1-620301f4c2d0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:30.230066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f1cbca58-a983-4ae8-b9a1-620301f4c2d0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:30.233748 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f1cbca58-a983-4ae8-b9a1-620301f4c2d0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:30.234200 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f1cbca58-a983-4ae8-b9a1-620301f4c2d0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:30.235010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f1cbca58-a983-4ae8-b9a1-620301f4c2d0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:30.235617 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f1cbca58-a983-4ae8-b9a1-620301f4c2d0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:30.385648 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f1cbca58-a983-4ae8-b9a1-620301f4c2d0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:30.393245 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f1cbca58-a983-4ae8-b9a1-620301f4c2d0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.170895 Jul 14 11:46:30.393827 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 162/285] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:30 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:31.019254 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-42a188d0-6224-4997-b2b8-3b40fae8bd0f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "POST /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.036073 Jul 14 11:46:31.029425 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 124/286] 10.222.0.40 () {62 vars in 1363 bytes} [Thu Jul 14 11:46:29 2022] POST /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments => generated 188 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:46:31.138418 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-647d4bbb-a0bc-46ea-bc76-8e6f11187001 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:46:31.142356 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-647d4bbb-a0bc-46ea-bc76-8e6f11187001 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:31.145640 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-647d4bbb-a0bc-46ea-bc76-8e6f11187001 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:31.146083 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-647d4bbb-a0bc-46ea-bc76-8e6f11187001 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:31.146844 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-647d4bbb-a0bc-46ea-bc76-8e6f11187001 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:31.147270 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-647d4bbb-a0bc-46ea-bc76-8e6f11187001 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:31.237217 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4e7b162e-60c7-4a77-aa0b-0126c8667deb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:31.237759 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-4e7b162e-60c7-4a77-aa0b-0126c8667deb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:31.244476 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4e7b162e-60c7-4a77-aa0b-0126c8667deb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:31.244924 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4e7b162e-60c7-4a77-aa0b-0126c8667deb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:31.245848 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4e7b162e-60c7-4a77-aa0b-0126c8667deb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:31.246289 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4e7b162e-60c7-4a77-aa0b-0126c8667deb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:31.376004 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-4e7b162e-60c7-4a77-aa0b-0126c8667deb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:31.383996 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-4e7b162e-60c7-4a77-aa0b-0126c8667deb tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1502 microversion: 2.1 time: 0.150724 Jul 14 11:46:31.384567 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 125/287] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:31 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:31.400863 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c4426208-a530-4406-acf1-89bbed03170c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:31.401542 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c4426208-a530-4406-acf1-89bbed03170c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:31.406225 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-647d4bbb-a0bc-46ea-bc76-8e6f11187001 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "POST /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/action" status: 202 len: 0 microversion: 2.20 time: 0.271322 Jul 14 11:46:31.406225 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 163/288] 10.222.0.40 () {62 vars in 1318 bytes} [Thu Jul 14 11:46:31 2022] POST /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:46:31.411545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d18e46e7-cc44-4ad2-9e1b-e98bef409d5c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:31.412162 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d18e46e7-cc44-4ad2-9e1b-e98bef409d5c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:31.412360 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c4426208-a530-4406-acf1-89bbed03170c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:31.412813 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c4426208-a530-4406-acf1-89bbed03170c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:31.413817 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c4426208-a530-4406-acf1-89bbed03170c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:31.414254 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c4426208-a530-4406-acf1-89bbed03170c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:31.418162 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d18e46e7-cc44-4ad2-9e1b-e98bef409d5c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:31.419005 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d18e46e7-cc44-4ad2-9e1b-e98bef409d5c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:31.419794 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d18e46e7-cc44-4ad2-9e1b-e98bef409d5c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:31.420232 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d18e46e7-cc44-4ad2-9e1b-e98bef409d5c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:31.562329 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-c4426208-a530-4406-acf1-89bbed03170c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:31.571331 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d18e46e7-cc44-4ad2-9e1b-e98bef409d5c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:31.572220 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c4426208-a530-4406-acf1-89bbed03170c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1514 microversion: 2.1 time: 0.175455 Jul 14 11:46:31.573211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 126/289] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:31 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:31.578397 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-42dccb4c-3a48-4e5a-b454-c48baec9568a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:31.579030 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-42dccb4c-3a48-4e5a-b454-c48baec9568a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:31.585346 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-42dccb4c-3a48-4e5a-b454-c48baec9568a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:31.585974 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-42dccb4c-3a48-4e5a-b454-c48baec9568a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:31.588657 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-42dccb4c-3a48-4e5a-b454-c48baec9568a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:31.588657 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-42dccb4c-3a48-4e5a-b454-c48baec9568a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:31.590753 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d18e46e7-cc44-4ad2-9e1b-e98bef409d5c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.183227 Jul 14 11:46:31.601413 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 164/290] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:31 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:31.750269 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-42dccb4c-3a48-4e5a-b454-c48baec9568a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:31.762124 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-42dccb4c-3a48-4e5a-b454-c48baec9568a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:31.764843 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-42dccb4c-3a48-4e5a-b454-c48baec9568a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:31.766100 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-42dccb4c-3a48-4e5a-b454-c48baec9568a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1811 microversion: 2.20 time: 0.191430 Jul 14 11:46:31.767257 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 127/291] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:31 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1811 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:32.607980 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-34436c75-9587-411a-b17d-fdae9e166768 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:32.608598 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-34436c75-9587-411a-b17d-fdae9e166768 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:32.614690 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-34436c75-9587-411a-b17d-fdae9e166768 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:32.615135 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-34436c75-9587-411a-b17d-fdae9e166768 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:32.615900 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-34436c75-9587-411a-b17d-fdae9e166768 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:32.616332 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-34436c75-9587-411a-b17d-fdae9e166768 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:32.752362 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-34436c75-9587-411a-b17d-fdae9e166768 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:32.758774 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-34436c75-9587-411a-b17d-fdae9e166768 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.154650 Jul 14 11:46:32.759286 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 165/292] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:32 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:32.793557 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-bfde305b-4486-457f-8727-b1fe6419085e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:32.794292 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-bfde305b-4486-457f-8727-b1fe6419085e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:32.801012 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bfde305b-4486-457f-8727-b1fe6419085e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:32.801943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bfde305b-4486-457f-8727-b1fe6419085e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:32.802788 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bfde305b-4486-457f-8727-b1fe6419085e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:32.803571 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bfde305b-4486-457f-8727-b1fe6419085e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:32.858784 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-754412567", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452"}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:46:32.910501 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.network.neutron [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] validate_networks() for None {{(pid=124947) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:46:32.939964 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-bfde305b-4486-457f-8727-b1fe6419085e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:32.949094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-bfde305b-4486-457f-8727-b1fe6419085e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:32.955514 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-bfde305b-4486-457f-8727-b1fe6419085e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:32.955514 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-bfde305b-4486-457f-8727-b1fe6419085e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1811 microversion: 2.20 time: 0.163190 Jul 14 11:46:32.955514 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 128/293] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:32 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1811 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:33.190918 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Flavor limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:46:33.191350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Image limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:46:33.191825 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Flavor pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:46:33.192298 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Image pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:46:33.192713 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:46:33.202754 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:33.203193 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:33.204024 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:33.204449 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:33.220724 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Getting quotas for project 1ec44d80054e49e9ba17a711740b1a3d. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:46:33.224624 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Getting quotas for user 983f6117721d436786fe8827a13a3f01 and project 1ec44d80054e49e9ba17a711740b1a3d. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:46:33.236037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Going to run 1 instances... {{(pid=124947) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:46:33.238360 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:46:33.321853 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e31fb406-9010-4736-b0cb-9507b8f6af07 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:46:33.322856 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e31fb406-9010-4736-b0cb-9507b8f6af07 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:33.328913 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e31fb406-9010-4736-b0cb-9507b8f6af07 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:33.329397 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e31fb406-9010-4736-b0cb-9507b8f6af07 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:33.330170 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e31fb406-9010-4736-b0cb-9507b8f6af07 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:33.330619 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e31fb406-9010-4736-b0cb-9507b8f6af07 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:33.347670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-e1a822b3-f02c-41fd-a7b1-c0b5f17b332e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492174 Jul 14 11:46:33.348526 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 166/294] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:46:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 11:46:33.356859 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-e31fb406-9010-4736-b0cb-9507b8f6af07 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lazy-loading 'flavor' on Instance uuid 336dc998-9572-45da-bf2b-b3490712426c {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:46:33.358737 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-03ac5cf4-d324-4365-8e4e-f14150a3376a tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:33.359351 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-03ac5cf4-d324-4365-8e4e-f14150a3376a tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:33.414926 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-03ac5cf4-d324-4365-8e4e-f14150a3376a tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:33.423404 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-03ac5cf4-d324-4365-8e4e-f14150a3376a tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1214 microversion: 2.1 time: 0.068266 Jul 14 11:46:33.423404 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 167/295] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:33 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:33.472313 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:33.677216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e31fb406-9010-4736-b0cb-9507b8f6af07 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "POST /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c/action" status: 200 len: 32 microversion: 2.1 time: 0.359364 Jul 14 11:46:33.677777 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 129/296] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 11:46:33 2022] POST /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c/action => generated 32 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 11:46:33.686911 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-bc85f545-3fe8-4f77-ac55-f79d673ec48f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:33.687532 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-bc85f545-3fe8-4f77-ac55-f79d673ec48f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:33.694369 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bc85f545-3fe8-4f77-ac55-f79d673ec48f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:33.694823 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bc85f545-3fe8-4f77-ac55-f79d673ec48f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:33.695595 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bc85f545-3fe8-4f77-ac55-f79d673ec48f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:33.696037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bc85f545-3fe8-4f77-ac55-f79d673ec48f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:33.777272 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-7fe9396e-37e8-4ea1-91b7-972927f5f348 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:33.778200 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-7fe9396e-37e8-4ea1-91b7-972927f5f348 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:33.786496 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7fe9396e-37e8-4ea1-91b7-972927f5f348 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:33.787044 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7fe9396e-37e8-4ea1-91b7-972927f5f348 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:33.787820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7fe9396e-37e8-4ea1-91b7-972927f5f348 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:33.788246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7fe9396e-37e8-4ea1-91b7-972927f5f348 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:33.842690 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-bc85f545-3fe8-4f77-ac55-f79d673ec48f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:33.850572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-bc85f545-3fe8-4f77-ac55-f79d673ec48f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.167688 Jul 14 11:46:33.851149 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 168/297] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:33 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:33.931185 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-7fe9396e-37e8-4ea1-91b7-972927f5f348 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:33.939499 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-7fe9396e-37e8-4ea1-91b7-972927f5f348 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.167192 Jul 14 11:46:33.940073 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 130/298] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:33 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:33.970953 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-92539c22-2b8f-4197-9765-7c2a3b07a7a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:33.971556 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-92539c22-2b8f-4197-9765-7c2a3b07a7a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:33.977718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-92539c22-2b8f-4197-9765-7c2a3b07a7a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:33.978163 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-92539c22-2b8f-4197-9765-7c2a3b07a7a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:33.978942 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-92539c22-2b8f-4197-9765-7c2a3b07a7a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:33.979373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-92539c22-2b8f-4197-9765-7c2a3b07a7a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:34.110746 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-92539c22-2b8f-4197-9765-7c2a3b07a7a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:34.119328 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-92539c22-2b8f-4197-9765-7c2a3b07a7a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:34.120844 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-92539c22-2b8f-4197-9765-7c2a3b07a7a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:34.122035 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-92539c22-2b8f-4197-9765-7c2a3b07a7a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1811 microversion: 2.20 time: 0.155068 Jul 14 11:46:34.122589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 169/299] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:33 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:34.439402 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d9295697-ec2e-4b1e-b0e2-3c22ac15a9c3 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:34.439927 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d9295697-ec2e-4b1e-b0e2-3c22ac15a9c3 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:34.446169 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d9295697-ec2e-4b1e-b0e2-3c22ac15a9c3 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:34.446601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d9295697-ec2e-4b1e-b0e2-3c22ac15a9c3 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:34.447365 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d9295697-ec2e-4b1e-b0e2-3c22ac15a9c3 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:34.447797 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d9295697-ec2e-4b1e-b0e2-3c22ac15a9c3 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:34.512412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d9295697-ec2e-4b1e-b0e2-3c22ac15a9c3 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:34.520081 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d9295697-ec2e-4b1e-b0e2-3c22ac15a9c3 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1218 microversion: 2.1 time: 0.085258 Jul 14 11:46:34.520650 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 131/300] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:34 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:34.867567 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1ebf9108-c874-4c68-8de9-fb4fe6b850a7 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:34.868179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1ebf9108-c874-4c68-8de9-fb4fe6b850a7 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:34.874327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1ebf9108-c874-4c68-8de9-fb4fe6b850a7 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:34.874776 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1ebf9108-c874-4c68-8de9-fb4fe6b850a7 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:34.875547 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1ebf9108-c874-4c68-8de9-fb4fe6b850a7 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:34.875983 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1ebf9108-c874-4c68-8de9-fb4fe6b850a7 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:34.956402 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-7cffb61c-82e4-47a7-8bab-09f52dbb5c80 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:34.957021 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-7cffb61c-82e4-47a7-8bab-09f52dbb5c80 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:34.963662 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7cffb61c-82e4-47a7-8bab-09f52dbb5c80 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:34.964107 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7cffb61c-82e4-47a7-8bab-09f52dbb5c80 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:34.964876 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7cffb61c-82e4-47a7-8bab-09f52dbb5c80 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:34.965346 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7cffb61c-82e4-47a7-8bab-09f52dbb5c80 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:35.008683 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1ebf9108-c874-4c68-8de9-fb4fe6b850a7 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:35.016430 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1ebf9108-c874-4c68-8de9-fb4fe6b850a7 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.152710 Jul 14 11:46:35.017009 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 170/301] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:34 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:35.096091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-7cffb61c-82e4-47a7-8bab-09f52dbb5c80 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:35.103731 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-7cffb61c-82e4-47a7-8bab-09f52dbb5c80 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.151238 Jul 14 11:46:35.104303 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 132/302] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:34 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:35.139631 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-abf9be3a-5ef2-4a0d-80d1-13f400105633 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:35.140242 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-abf9be3a-5ef2-4a0d-80d1-13f400105633 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:35.146245 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-abf9be3a-5ef2-4a0d-80d1-13f400105633 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:35.146690 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-abf9be3a-5ef2-4a0d-80d1-13f400105633 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:35.147452 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-abf9be3a-5ef2-4a0d-80d1-13f400105633 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:35.147887 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-abf9be3a-5ef2-4a0d-80d1-13f400105633 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:35.273757 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-abf9be3a-5ef2-4a0d-80d1-13f400105633 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:35.283165 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-abf9be3a-5ef2-4a0d-80d1-13f400105633 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:35.284694 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-abf9be3a-5ef2-4a0d-80d1-13f400105633 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:35.285888 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-abf9be3a-5ef2-4a0d-80d1-13f400105633 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1811 microversion: 2.20 time: 0.150115 Jul 14 11:46:35.286443 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 171/303] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:35 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1811 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:35.537124 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-74149f21-67c1-45ae-b667-98729bc6c0bb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:35.537854 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-74149f21-67c1-45ae-b667-98729bc6c0bb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:35.544042 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-74149f21-67c1-45ae-b667-98729bc6c0bb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:35.544492 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-74149f21-67c1-45ae-b667-98729bc6c0bb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:35.545362 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-74149f21-67c1-45ae-b667-98729bc6c0bb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:35.545803 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-74149f21-67c1-45ae-b667-98729bc6c0bb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:35.609701 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-74149f21-67c1-45ae-b667-98729bc6c0bb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:35.617058 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-74149f21-67c1-45ae-b667-98729bc6c0bb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1218 microversion: 2.1 time: 0.083896 Jul 14 11:46:35.617655 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 133/304] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:35 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:36.033874 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-19e3feb0-df86-4534-aaf7-0ff382244886 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:36.034491 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-19e3feb0-df86-4534-aaf7-0ff382244886 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:36.040560 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-19e3feb0-df86-4534-aaf7-0ff382244886 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:36.041009 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-19e3feb0-df86-4534-aaf7-0ff382244886 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:36.041819 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-19e3feb0-df86-4534-aaf7-0ff382244886 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:36.042256 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-19e3feb0-df86-4534-aaf7-0ff382244886 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:36.120981 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ba86cf4f-aa74-4a8d-88dd-74cc124ed97f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:36.121607 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ba86cf4f-aa74-4a8d-88dd-74cc124ed97f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:36.128711 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba86cf4f-aa74-4a8d-88dd-74cc124ed97f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:36.129166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba86cf4f-aa74-4a8d-88dd-74cc124ed97f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:36.129945 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba86cf4f-aa74-4a8d-88dd-74cc124ed97f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:36.130387 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba86cf4f-aa74-4a8d-88dd-74cc124ed97f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:36.172998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-19e3feb0-df86-4534-aaf7-0ff382244886 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:36.176752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:36.181148 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-19e3feb0-df86-4534-aaf7-0ff382244886 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.151417 Jul 14 11:46:36.181739 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 172/305] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:36 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:36.259273 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ba86cf4f-aa74-4a8d-88dd-74cc124ed97f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:36.266886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ba86cf4f-aa74-4a8d-88dd-74cc124ed97f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.149750 Jul 14 11:46:36.267465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 134/306] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:36 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:36.303044 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-292c4937-b324-4f9b-b956-12765896b02c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:36.303656 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-292c4937-b324-4f9b-b956-12765896b02c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:36.305834 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:36.311529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-292c4937-b324-4f9b-b956-12765896b02c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:36.311984 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-292c4937-b324-4f9b-b956-12765896b02c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:36.312753 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-292c4937-b324-4f9b-b956-12765896b02c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:36.313215 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-292c4937-b324-4f9b-b956-12765896b02c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:36.449631 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-292c4937-b324-4f9b-b956-12765896b02c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:36.458473 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-292c4937-b324-4f9b-b956-12765896b02c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:36.459985 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-292c4937-b324-4f9b-b956-12765896b02c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:36.461138 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-292c4937-b324-4f9b-b956-12765896b02c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1811 microversion: 2.20 time: 0.161986 Jul 14 11:46:36.461711 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 173/307] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:36 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:36.634024 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-739b756f-a7c5-4a0e-8261-b27b3437a3be tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:36.634572 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-739b756f-a7c5-4a0e-8261-b27b3437a3be tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:36.640600 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-739b756f-a7c5-4a0e-8261-b27b3437a3be tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:36.641038 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-739b756f-a7c5-4a0e-8261-b27b3437a3be tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:36.641833 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-739b756f-a7c5-4a0e-8261-b27b3437a3be tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:36.642266 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-739b756f-a7c5-4a0e-8261-b27b3437a3be tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:36.701597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-739b756f-a7c5-4a0e-8261-b27b3437a3be tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:36.708931 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-739b756f-a7c5-4a0e-8261-b27b3437a3be tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1218 microversion: 2.1 time: 0.078910 Jul 14 11:46:36.709503 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 135/308] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:36 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:37.198434 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-02feec30-cc0c-4103-b2b1-777de196932e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:37.199034 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-02feec30-cc0c-4103-b2b1-777de196932e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:37.205895 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-02feec30-cc0c-4103-b2b1-777de196932e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:37.206342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-02feec30-cc0c-4103-b2b1-777de196932e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:37.207085 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-02feec30-cc0c-4103-b2b1-777de196932e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:37.207517 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-02feec30-cc0c-4103-b2b1-777de196932e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:37.284190 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b168380a-b035-4f56-9f76-3c7aa6426137 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:37.284884 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b168380a-b035-4f56-9f76-3c7aa6426137 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:37.291586 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b168380a-b035-4f56-9f76-3c7aa6426137 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:37.292034 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b168380a-b035-4f56-9f76-3c7aa6426137 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:37.292811 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b168380a-b035-4f56-9f76-3c7aa6426137 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:37.293282 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b168380a-b035-4f56-9f76-3c7aa6426137 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:37.335180 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-02feec30-cc0c-4103-b2b1-777de196932e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:37.343183 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-02feec30-cc0c-4103-b2b1-777de196932e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.148527 Jul 14 11:46:37.343770 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 174/309] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:37 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:37.440510 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b168380a-b035-4f56-9f76-3c7aa6426137 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:37.448636 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b168380a-b035-4f56-9f76-3c7aa6426137 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.168314 Jul 14 11:46:37.449142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 136/310] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:37 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:37.479433 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-59c10e79-ffd0-4b94-a3ed-3a68caca4ec2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:37.480132 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-59c10e79-ffd0-4b94-a3ed-3a68caca4ec2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:37.487097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-59c10e79-ffd0-4b94-a3ed-3a68caca4ec2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:37.487547 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-59c10e79-ffd0-4b94-a3ed-3a68caca4ec2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:37.488332 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-59c10e79-ffd0-4b94-a3ed-3a68caca4ec2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:37.488766 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-59c10e79-ffd0-4b94-a3ed-3a68caca4ec2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:37.618465 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-59c10e79-ffd0-4b94-a3ed-3a68caca4ec2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:37.627653 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-59c10e79-ffd0-4b94-a3ed-3a68caca4ec2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:37.629199 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-59c10e79-ffd0-4b94-a3ed-3a68caca4ec2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:37.630367 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-59c10e79-ffd0-4b94-a3ed-3a68caca4ec2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1811 microversion: 2.20 time: 0.155071 Jul 14 11:46:37.630927 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 175/311] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:37 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:37.726204 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6af75808-9716-4da3-a2fc-b5f931843540 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:37.726767 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6af75808-9716-4da3-a2fc-b5f931843540 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:37.733396 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6af75808-9716-4da3-a2fc-b5f931843540 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:37.733843 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6af75808-9716-4da3-a2fc-b5f931843540 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:37.734599 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6af75808-9716-4da3-a2fc-b5f931843540 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:37.735035 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6af75808-9716-4da3-a2fc-b5f931843540 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:37.793673 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6af75808-9716-4da3-a2fc-b5f931843540 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:37.801766 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6af75808-9716-4da3-a2fc-b5f931843540 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1218 microversion: 2.1 time: 0.079454 Jul 14 11:46:37.802344 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 137/312] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:37 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:38.368966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ea625a5d-62f1-4ee3-a6a4-b971fc2e8905 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:38.369654 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ea625a5d-62f1-4ee3-a6a4-b971fc2e8905 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:38.375855 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ea625a5d-62f1-4ee3-a6a4-b971fc2e8905 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:38.376297 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ea625a5d-62f1-4ee3-a6a4-b971fc2e8905 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:38.377056 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ea625a5d-62f1-4ee3-a6a4-b971fc2e8905 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:38.377510 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ea625a5d-62f1-4ee3-a6a4-b971fc2e8905 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:38.466189 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-067138a2-5ee9-4965-add4-1bfdb51e411c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:38.467496 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-067138a2-5ee9-4965-add4-1bfdb51e411c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:38.474197 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-067138a2-5ee9-4965-add4-1bfdb51e411c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:38.474645 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-067138a2-5ee9-4965-add4-1bfdb51e411c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:38.475412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-067138a2-5ee9-4965-add4-1bfdb51e411c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:38.475852 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-067138a2-5ee9-4965-add4-1bfdb51e411c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:38.509895 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ea625a5d-62f1-4ee3-a6a4-b971fc2e8905 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:38.518120 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ea625a5d-62f1-4ee3-a6a4-b971fc2e8905 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.153100 Jul 14 11:46:38.518693 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 176/313] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:38 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:38.606887 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-067138a2-5ee9-4965-add4-1bfdb51e411c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:38.614320 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-067138a2-5ee9-4965-add4-1bfdb51e411c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.151962 Jul 14 11:46:38.614888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 138/314] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:38 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:38.647868 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-adaebf02-8f2d-4a96-9327-2f461db4e67a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:38.648397 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-adaebf02-8f2d-4a96-9327-2f461db4e67a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:38.654594 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-adaebf02-8f2d-4a96-9327-2f461db4e67a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:38.655033 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-adaebf02-8f2d-4a96-9327-2f461db4e67a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:38.655791 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-adaebf02-8f2d-4a96-9327-2f461db4e67a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:38.656220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-adaebf02-8f2d-4a96-9327-2f461db4e67a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:38.787190 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-adaebf02-8f2d-4a96-9327-2f461db4e67a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:38.795638 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-adaebf02-8f2d-4a96-9327-2f461db4e67a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:38.797210 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-adaebf02-8f2d-4a96-9327-2f461db4e67a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:38.798393 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-adaebf02-8f2d-4a96-9327-2f461db4e67a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1811 microversion: 2.20 time: 0.154571 Jul 14 11:46:38.798958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 177/315] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:38 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:38.818388 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-50722a48-917a-443c-b840-cb49d936e33b tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:38.818998 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-50722a48-917a-443c-b840-cb49d936e33b tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:38.825928 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50722a48-917a-443c-b840-cb49d936e33b tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:38.826978 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50722a48-917a-443c-b840-cb49d936e33b tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:38.827784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50722a48-917a-443c-b840-cb49d936e33b tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:38.828226 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50722a48-917a-443c-b840-cb49d936e33b tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:38.892191 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-50722a48-917a-443c-b840-cb49d936e33b tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:38.900050 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-50722a48-917a-443c-b840-cb49d936e33b tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1218 microversion: 2.1 time: 0.085442 Jul 14 11:46:38.900547 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 139/316] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:38 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:39.537122 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-84e37f41-db7f-44e5-80e2-5107ee9a14f3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:39.537839 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-84e37f41-db7f-44e5-80e2-5107ee9a14f3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:39.544008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-84e37f41-db7f-44e5-80e2-5107ee9a14f3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:39.544444 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-84e37f41-db7f-44e5-80e2-5107ee9a14f3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:39.545896 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-84e37f41-db7f-44e5-80e2-5107ee9a14f3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:39.546324 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-84e37f41-db7f-44e5-80e2-5107ee9a14f3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:39.631767 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d6aec907-63ff-49f6-aa87-5627504c480f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:39.632416 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d6aec907-63ff-49f6-aa87-5627504c480f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:39.638974 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d6aec907-63ff-49f6-aa87-5627504c480f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:39.639429 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d6aec907-63ff-49f6-aa87-5627504c480f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:39.640200 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d6aec907-63ff-49f6-aa87-5627504c480f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:39.640753 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d6aec907-63ff-49f6-aa87-5627504c480f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:39.675856 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-84e37f41-db7f-44e5-80e2-5107ee9a14f3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:39.683562 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-84e37f41-db7f-44e5-80e2-5107ee9a14f3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.151492 Jul 14 11:46:39.684140 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 178/317] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:39 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:39.770162 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d6aec907-63ff-49f6-aa87-5627504c480f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:39.777742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d6aec907-63ff-49f6-aa87-5627504c480f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.149875 Jul 14 11:46:39.778305 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 140/318] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:39 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:39.816180 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-15940141-863a-4134-8d0b-20d862f07407 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:39.816793 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-15940141-863a-4134-8d0b-20d862f07407 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:39.822890 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-15940141-863a-4134-8d0b-20d862f07407 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:39.823343 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-15940141-863a-4134-8d0b-20d862f07407 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:39.824108 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-15940141-863a-4134-8d0b-20d862f07407 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:39.824544 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-15940141-863a-4134-8d0b-20d862f07407 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:39.916281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-024f9bc3-0e05-4b0f-862c-f95f44b658f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:39.916894 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-024f9bc3-0e05-4b0f-862c-f95f44b658f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:39.922891 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-024f9bc3-0e05-4b0f-862c-f95f44b658f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:39.923330 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-024f9bc3-0e05-4b0f-862c-f95f44b658f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:39.924090 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-024f9bc3-0e05-4b0f-862c-f95f44b658f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:39.924516 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-024f9bc3-0e05-4b0f-862c-f95f44b658f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:39.953997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-15940141-863a-4134-8d0b-20d862f07407 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:39.963006 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-15940141-863a-4134-8d0b-20d862f07407 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:39.964693 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-15940141-863a-4134-8d0b-20d862f07407 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:39.965858 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-15940141-863a-4134-8d0b-20d862f07407 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1811 microversion: 2.20 time: 0.153719 Jul 14 11:46:39.966649 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 179/319] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:39 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:39.985059 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-024f9bc3-0e05-4b0f-862c-f95f44b658f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:39.992518 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-024f9bc3-0e05-4b0f-862c-f95f44b658f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1218 microversion: 2.1 time: 0.080055 Jul 14 11:46:39.993075 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 141/320] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:39 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:40.700154 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-efd63d8e-facd-4b09-b194-9ea20d27f041 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:40.700769 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-efd63d8e-facd-4b09-b194-9ea20d27f041 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:40.707843 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-efd63d8e-facd-4b09-b194-9ea20d27f041 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:40.708317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-efd63d8e-facd-4b09-b194-9ea20d27f041 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:40.709483 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-efd63d8e-facd-4b09-b194-9ea20d27f041 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:40.709925 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-efd63d8e-facd-4b09-b194-9ea20d27f041 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:40.795925 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6ece6ce7-a2ca-4b6d-8867-b1e0beafac00 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:40.796549 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6ece6ce7-a2ca-4b6d-8867-b1e0beafac00 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:40.804336 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6ece6ce7-a2ca-4b6d-8867-b1e0beafac00 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:40.804670 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6ece6ce7-a2ca-4b6d-8867-b1e0beafac00 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:40.805484 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6ece6ce7-a2ca-4b6d-8867-b1e0beafac00 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:40.805926 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6ece6ce7-a2ca-4b6d-8867-b1e0beafac00 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:40.851556 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-efd63d8e-facd-4b09-b194-9ea20d27f041 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:40.859926 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-efd63d8e-facd-4b09-b194-9ea20d27f041 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.163963 Jul 14 11:46:40.860640 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 180/321] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:40 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:40.942017 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6ece6ce7-a2ca-4b6d-8867-b1e0beafac00 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:40.949516 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6ece6ce7-a2ca-4b6d-8867-b1e0beafac00 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.157990 Jul 14 11:46:40.950079 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 142/322] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:40 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:40.984414 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f937493d-2c9a-4ae5-a54e-e6570bf77bce tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:40.985027 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f937493d-2c9a-4ae5-a54e-e6570bf77bce tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:40.991104 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f937493d-2c9a-4ae5-a54e-e6570bf77bce tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:40.991552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f937493d-2c9a-4ae5-a54e-e6570bf77bce tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:40.992341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f937493d-2c9a-4ae5-a54e-e6570bf77bce tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:40.992777 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f937493d-2c9a-4ae5-a54e-e6570bf77bce tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:41.012317 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5b976692-2e5e-4944-a442-0bea6628e542 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:41.013027 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5b976692-2e5e-4944-a442-0bea6628e542 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:41.019578 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5b976692-2e5e-4944-a442-0bea6628e542 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:41.020033 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5b976692-2e5e-4944-a442-0bea6628e542 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:41.020814 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5b976692-2e5e-4944-a442-0bea6628e542 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:41.021295 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5b976692-2e5e-4944-a442-0bea6628e542 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:41.089191 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5b976692-2e5e-4944-a442-0bea6628e542 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:41.098240 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5b976692-2e5e-4944-a442-0bea6628e542 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1218 microversion: 2.1 time: 0.090737 Jul 14 11:46:41.100630 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 143/323] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:41 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:41.130272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f937493d-2c9a-4ae5-a54e-e6570bf77bce tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:41.142020 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f937493d-2c9a-4ae5-a54e-e6570bf77bce tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:41.143572 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f937493d-2c9a-4ae5-a54e-e6570bf77bce tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:41.144781 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f937493d-2c9a-4ae5-a54e-e6570bf77bce tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1811 microversion: 2.20 time: 0.164947 Jul 14 11:46:41.145693 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 181/324] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:40 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:41.877973 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-07e34c3b-08ca-478f-b9b3-72dd5a0062ae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:41.878593 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-07e34c3b-08ca-478f-b9b3-72dd5a0062ae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:41.885324 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-07e34c3b-08ca-478f-b9b3-72dd5a0062ae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:41.885781 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-07e34c3b-08ca-478f-b9b3-72dd5a0062ae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:41.886562 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-07e34c3b-08ca-478f-b9b3-72dd5a0062ae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:41.887007 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-07e34c3b-08ca-478f-b9b3-72dd5a0062ae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:41.966210 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-10ad59e5-ab5f-4674-ae57-29a368f926e8 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:41.966915 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-10ad59e5-ab5f-4674-ae57-29a368f926e8 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:41.973089 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-10ad59e5-ab5f-4674-ae57-29a368f926e8 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:41.973578 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-10ad59e5-ab5f-4674-ae57-29a368f926e8 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:41.975435 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-10ad59e5-ab5f-4674-ae57-29a368f926e8 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:41.975435 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-10ad59e5-ab5f-4674-ae57-29a368f926e8 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:42.129498 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-07e34c3b-08ca-478f-b9b3-72dd5a0062ae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:42.144389 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-07e34c3b-08ca-478f-b9b3-72dd5a0062ae tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.270384 Jul 14 11:46:42.145257 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 144/325] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:41 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:42.150539 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d3a881a2-d447-430f-ac01-00c6f64fc6e6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:42.151397 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d3a881a2-d447-430f-ac01-00c6f64fc6e6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:42.158385 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d3a881a2-d447-430f-ac01-00c6f64fc6e6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:42.166796 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d3a881a2-d447-430f-ac01-00c6f64fc6e6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:42.168501 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d3a881a2-d447-430f-ac01-00c6f64fc6e6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:42.170371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d3a881a2-d447-430f-ac01-00c6f64fc6e6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:42.203143 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:42.278869 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d3a881a2-d447-430f-ac01-00c6f64fc6e6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:42.288114 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d3a881a2-d447-430f-ac01-00c6f64fc6e6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1266 microversion: 2.1 time: 0.141599 Jul 14 11:46:42.288939 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 145/326] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:42 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:42.298835 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-341ed91b-7612-4da6-b121-d4401673f5e1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:42.299806 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-341ed91b-7612-4da6-b121-d4401673f5e1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:42.307650 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-341ed91b-7612-4da6-b121-d4401673f5e1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:42.311209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-341ed91b-7612-4da6-b121-d4401673f5e1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:42.311209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-341ed91b-7612-4da6-b121-d4401673f5e1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:42.311209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-341ed91b-7612-4da6-b121-d4401673f5e1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:42.375721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-10ad59e5-ab5f-4674-ae57-29a368f926e8 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:42.384823 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-10ad59e5-ab5f-4674-ae57-29a368f926e8 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.422338 Jul 14 11:46:42.385863 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 182/327] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:41 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:42.459435 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-341ed91b-7612-4da6-b121-d4401673f5e1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:42.468876 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-341ed91b-7612-4da6-b121-d4401673f5e1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:42.470593 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-341ed91b-7612-4da6-b121-d4401673f5e1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:42.471823 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-341ed91b-7612-4da6-b121-d4401673f5e1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1753 microversion: 2.20 time: 0.181400 Jul 14 11:46:42.473041 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 146/328] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:42 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:43.164179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-012c1615-e74a-4d8c-8abf-dfd41168c56a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:43.165389 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-012c1615-e74a-4d8c-8abf-dfd41168c56a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:43.172033 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-012c1615-e74a-4d8c-8abf-dfd41168c56a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:43.172738 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-012c1615-e74a-4d8c-8abf-dfd41168c56a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:43.174030 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-012c1615-e74a-4d8c-8abf-dfd41168c56a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:43.174625 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-012c1615-e74a-4d8c-8abf-dfd41168c56a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:43.218953 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:43.308411 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-1c1b6336-358e-4626-976a-a846dab4f955 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:43.309880 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-1c1b6336-358e-4626-976a-a846dab4f955 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:43.321623 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-012c1615-e74a-4d8c-8abf-dfd41168c56a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:43.322504 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1c1b6336-358e-4626-976a-a846dab4f955 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:43.323132 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1c1b6336-358e-4626-976a-a846dab4f955 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:43.324192 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1c1b6336-358e-4626-976a-a846dab4f955 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:43.324918 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1c1b6336-358e-4626-976a-a846dab4f955 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:43.331810 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-012c1615-e74a-4d8c-8abf-dfd41168c56a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.171621 Jul 14 11:46:43.337539 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 183/329] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:43 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:43.402170 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3b96800e-510e-43fe-b45f-6ce52979f517 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:43.402632 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-1c1b6336-358e-4626-976a-a846dab4f955 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:43.402785 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3b96800e-510e-43fe-b45f-6ce52979f517 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:43.409466 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3b96800e-510e-43fe-b45f-6ce52979f517 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:43.410154 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3b96800e-510e-43fe-b45f-6ce52979f517 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:43.411095 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3b96800e-510e-43fe-b45f-6ce52979f517 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:43.411718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3b96800e-510e-43fe-b45f-6ce52979f517 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:43.411841 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-1c1b6336-358e-4626-976a-a846dab4f955 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1272 microversion: 2.1 time: 0.109117 Jul 14 11:46:43.412869 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 147/330] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:43 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1272 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:43.428381 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=8 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:43.492226 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6c422b2b-4c44-4b69-840c-f473c7ef89d1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:43.492868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6c422b2b-4c44-4b69-840c-f473c7ef89d1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:43.500949 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6c422b2b-4c44-4b69-840c-f473c7ef89d1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:43.501436 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6c422b2b-4c44-4b69-840c-f473c7ef89d1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:43.502243 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6c422b2b-4c44-4b69-840c-f473c7ef89d1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:43.502680 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6c422b2b-4c44-4b69-840c-f473c7ef89d1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:43.570454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3b96800e-510e-43fe-b45f-6ce52979f517 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:43.579153 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3b96800e-510e-43fe-b45f-6ce52979f517 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.181301 Jul 14 11:46:43.579741 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 184/331] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:43 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:43.667177 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6c422b2b-4c44-4b69-840c-f473c7ef89d1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:43.676029 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6c422b2b-4c44-4b69-840c-f473c7ef89d1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:43.677860 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6c422b2b-4c44-4b69-840c-f473c7ef89d1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:43.679062 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6c422b2b-4c44-4b69-840c-f473c7ef89d1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1753 microversion: 2.20 time: 0.191443 Jul 14 11:46:43.679624 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 148/332] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:43 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:46:44.350404 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-13c50dd1-91b9-4ba6-9a39-f38db6e6277b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:44.351030 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-13c50dd1-91b9-4ba6-9a39-f38db6e6277b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:44.358434 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-13c50dd1-91b9-4ba6-9a39-f38db6e6277b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:44.359205 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-13c50dd1-91b9-4ba6-9a39-f38db6e6277b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:44.360114 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-13c50dd1-91b9-4ba6-9a39-f38db6e6277b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:44.360757 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-13c50dd1-91b9-4ba6-9a39-f38db6e6277b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:44.428896 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6e5bc6b8-7c4d-4af6-ac2f-d23268802b62 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:44.430760 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6e5bc6b8-7c4d-4af6-ac2f-d23268802b62 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:44.439261 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6e5bc6b8-7c4d-4af6-ac2f-d23268802b62 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:44.439966 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6e5bc6b8-7c4d-4af6-ac2f-d23268802b62 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:44.441382 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6e5bc6b8-7c4d-4af6-ac2f-d23268802b62 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:44.442162 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6e5bc6b8-7c4d-4af6-ac2f-d23268802b62 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:44.544043 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-13c50dd1-91b9-4ba6-9a39-f38db6e6277b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:44.552975 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-13c50dd1-91b9-4ba6-9a39-f38db6e6277b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.207671 Jul 14 11:46:44.563077 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 185/333] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:44 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:44.601569 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9dedb12d-bec6-4434-a2c2-bcb114ecf15e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:44.607435 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9dedb12d-bec6-4434-a2c2-bcb114ecf15e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:44.608463 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9dedb12d-bec6-4434-a2c2-bcb114ecf15e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:44.608902 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9dedb12d-bec6-4434-a2c2-bcb114ecf15e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:44.609905 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9dedb12d-bec6-4434-a2c2-bcb114ecf15e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:44.610546 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9dedb12d-bec6-4434-a2c2-bcb114ecf15e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:44.751959 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9dedb12d-bec6-4434-a2c2-bcb114ecf15e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:44.759762 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9dedb12d-bec6-4434-a2c2-bcb114ecf15e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.165660 Jul 14 11:46:44.760473 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 186/334] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:44 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:44.766038 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9e049418-143b-4f3d-a358-4292a608f453 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:44.766846 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9e049418-143b-4f3d-a358-4292a608f453 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:44.773070 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9e049418-143b-4f3d-a358-4292a608f453 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:44.773793 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9e049418-143b-4f3d-a358-4292a608f453 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:44.775005 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9e049418-143b-4f3d-a358-4292a608f453 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:44.775599 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9e049418-143b-4f3d-a358-4292a608f453 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:44.785389 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6e5bc6b8-7c4d-4af6-ac2f-d23268802b62 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:44.787191 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6e5bc6b8-7c4d-4af6-ac2f-d23268802b62 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.362001 Jul 14 11:46:44.796209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 149/335] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:44 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:44.832929 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-e3f5a701-e5e1-4227-8538-3f9cf62efe36 req-c3df0d2a-e228-44d8-afc7-c1cd2dd5ae15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee797cbe-7b7e-4e87-9da7-0c628ae3ede1", "name": "network-vif-plugged", "status": "completed", "tag": "df04a441-a4c9-485f-845a-68acb74d2d4e"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:46:44.844220 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-e3f5a701-e5e1-4227-8538-3f9cf62efe36 req-c3df0d2a-e228-44d8-afc7-c1cd2dd5ae15 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:44.844220 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-e3f5a701-e5e1-4227-8538-3f9cf62efe36 req-c3df0d2a-e228-44d8-afc7-c1cd2dd5ae15 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:44.859980 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-e3f5a701-e5e1-4227-8538-3f9cf62efe36 req-c3df0d2a-e228-44d8-afc7-c1cd2dd5ae15 service nova] Creating event network-vif-plugged:df04a441-a4c9-485f-845a-68acb74d2d4e for instance ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 on hv-cinder-84980 Jul 14 11:46:44.869478 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-e3f5a701-e5e1-4227-8538-3f9cf62efe36 req-c3df0d2a-e228-44d8-afc7-c1cd2dd5ae15 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038709 Jul 14 11:46:44.873004 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 150/336] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:46:44.943624 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9e049418-143b-4f3d-a358-4292a608f453 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:44.952512 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9e049418-143b-4f3d-a358-4292a608f453 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:44.954079 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9e049418-143b-4f3d-a358-4292a608f453 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:44.955265 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9e049418-143b-4f3d-a358-4292a608f453 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.193402 Jul 14 11:46:44.955843 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 187/337] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:44 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:45.571108 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-8b6f53bf-095b-45a4-83e8-88ee86da2f98 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:45.578123 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-8b6f53bf-095b-45a4-83e8-88ee86da2f98 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:45.578248 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8b6f53bf-095b-45a4-83e8-88ee86da2f98 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:45.578682 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8b6f53bf-095b-45a4-83e8-88ee86da2f98 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:45.579445 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8b6f53bf-095b-45a4-83e8-88ee86da2f98 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:45.579881 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8b6f53bf-095b-45a4-83e8-88ee86da2f98 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:45.747346 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-fdc2a999-4d04-490f-84f1-17d53aeae947 req-d91d2e03-b07e-47ce-913c-59ea931ffb6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70b1731-0a31-4df3-99fe-42587445a297", "tag": "ba72d0b2-3ada-4475-825a-02b31c695891"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:46:45.760538 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-fdc2a999-4d04-490f-84f1-17d53aeae947 req-d91d2e03-b07e-47ce-913c-59ea931ffb6c service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:45.760985 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-fdc2a999-4d04-490f-84f1-17d53aeae947 req-d91d2e03-b07e-47ce-913c-59ea931ffb6c service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:45.773622 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-fdc2a999-4d04-490f-84f1-17d53aeae947 req-d91d2e03-b07e-47ce-913c-59ea931ffb6c service nova] Creating event network-changed:ba72d0b2-3ada-4475-825a-02b31c695891 for instance a70b1731-0a31-4df3-99fe-42587445a297 on hv-cinder-84980 Jul 14 11:46:45.780280 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-fdc2a999-4d04-490f-84f1-17d53aeae947 req-d91d2e03-b07e-47ce-913c-59ea931ffb6c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036358 Jul 14 11:46:45.781232 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 188/338] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:46:45.786879 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1e6eb9e1-74d3-4690-a079-571c3f1f475c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:45.787527 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1e6eb9e1-74d3-4690-a079-571c3f1f475c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:45.801566 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8b6f53bf-095b-45a4-83e8-88ee86da2f98 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:45.811151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-8b6f53bf-095b-45a4-83e8-88ee86da2f98 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.244316 Jul 14 11:46:45.812156 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 151/339] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:45 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:45.816983 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-12fe5985-aefa-4de1-941d-5967794de4c6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:45.822055 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1e6eb9e1-74d3-4690-a079-571c3f1f475c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:45.822529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1e6eb9e1-74d3-4690-a079-571c3f1f475c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:45.823299 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1e6eb9e1-74d3-4690-a079-571c3f1f475c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:45.828526 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1e6eb9e1-74d3-4690-a079-571c3f1f475c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:45.828663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-12fe5985-aefa-4de1-941d-5967794de4c6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:45.835757 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-12fe5985-aefa-4de1-941d-5967794de4c6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:45.836214 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-12fe5985-aefa-4de1-941d-5967794de4c6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:45.837003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-12fe5985-aefa-4de1-941d-5967794de4c6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:45.844514 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-12fe5985-aefa-4de1-941d-5967794de4c6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:45.989781 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1e6eb9e1-74d3-4690-a079-571c3f1f475c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:45.996828 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1e6eb9e1-74d3-4690-a079-571c3f1f475c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.214176 Jul 14 11:46:46.006884 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 189/340] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:45 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:46.012215 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7cc61f29-57b7-4fed-b368-60c685eb09db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:46.012824 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7cc61f29-57b7-4fed-b368-60c685eb09db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:46.020635 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7cc61f29-57b7-4fed-b368-60c685eb09db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:46.021432 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7cc61f29-57b7-4fed-b368-60c685eb09db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:46.022979 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7cc61f29-57b7-4fed-b368-60c685eb09db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:46.023761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7cc61f29-57b7-4fed-b368-60c685eb09db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:46.030060 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=100 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:46.059978 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-12fe5985-aefa-4de1-941d-5967794de4c6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:46.068661 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-12fe5985-aefa-4de1-941d-5967794de4c6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.255301 Jul 14 11:46:46.069627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 152/341] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:45 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:46.174614 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7cc61f29-57b7-4fed-b368-60c685eb09db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:46.183804 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7cc61f29-57b7-4fed-b368-60c685eb09db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:46.185399 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7cc61f29-57b7-4fed-b368-60c685eb09db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:46.186584 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7cc61f29-57b7-4fed-b368-60c685eb09db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.178239 Jul 14 11:46:46.187296 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 190/342] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:46 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:46.827718 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-1b01c232-a055-40ba-ac59-e35623f418bf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:46.828362 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-1b01c232-a055-40ba-ac59-e35623f418bf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:46.834776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1b01c232-a055-40ba-ac59-e35623f418bf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:46.835235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1b01c232-a055-40ba-ac59-e35623f418bf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:46.836009 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1b01c232-a055-40ba-ac59-e35623f418bf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:46.836442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1b01c232-a055-40ba-ac59-e35623f418bf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:46.971521 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-1b01c232-a055-40ba-ac59-e35623f418bf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:46.980050 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-1b01c232-a055-40ba-ac59-e35623f418bf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.156110 Jul 14 11:46:46.980642 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 153/343] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:46 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:47.014319 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ced68366-b944-41a4-910d-8a249b682816 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:47.015004 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ced68366-b944-41a4-910d-8a249b682816 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:47.021185 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ced68366-b944-41a4-910d-8a249b682816 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:47.021651 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ced68366-b944-41a4-910d-8a249b682816 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:47.022476 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ced68366-b944-41a4-910d-8a249b682816 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:47.022906 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ced68366-b944-41a4-910d-8a249b682816 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:47.086787 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-24f2b93d-dec9-4be5-a8ac-08db30343560 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:47.086787 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-24f2b93d-dec9-4be5-a8ac-08db30343560 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:47.093525 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-24f2b93d-dec9-4be5-a8ac-08db30343560 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:47.094057 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-24f2b93d-dec9-4be5-a8ac-08db30343560 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:47.094897 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-24f2b93d-dec9-4be5-a8ac-08db30343560 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:47.095772 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-24f2b93d-dec9-4be5-a8ac-08db30343560 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:47.168397 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ced68366-b944-41a4-910d-8a249b682816 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:47.176595 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ced68366-b944-41a4-910d-8a249b682816 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.166267 Jul 14 11:46:47.177402 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 191/344] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:47 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:47.204006 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9ff4531b-837e-4a9c-a2ba-0c0764580ec8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:47.204746 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9ff4531b-837e-4a9c-a2ba-0c0764580ec8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:47.217454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9ff4531b-837e-4a9c-a2ba-0c0764580ec8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:47.217454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9ff4531b-837e-4a9c-a2ba-0c0764580ec8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:47.218105 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9ff4531b-837e-4a9c-a2ba-0c0764580ec8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:47.218532 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9ff4531b-837e-4a9c-a2ba-0c0764580ec8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:47.235816 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-24f2b93d-dec9-4be5-a8ac-08db30343560 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:47.251444 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-24f2b93d-dec9-4be5-a8ac-08db30343560 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.169134 Jul 14 11:46:47.255446 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 154/345] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:47 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:47.361232 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9ff4531b-837e-4a9c-a2ba-0c0764580ec8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:47.370736 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9ff4531b-837e-4a9c-a2ba-0c0764580ec8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:47.372343 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9ff4531b-837e-4a9c-a2ba-0c0764580ec8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:47.373581 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9ff4531b-837e-4a9c-a2ba-0c0764580ec8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.173602 Jul 14 11:46:47.374142 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 192/346] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:47 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:46:47.998689 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-50840687-ed8c-4eee-b331-6d52760d2ba1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:47.999302 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-50840687-ed8c-4eee-b331-6d52760d2ba1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:48.006522 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50840687-ed8c-4eee-b331-6d52760d2ba1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:48.006972 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50840687-ed8c-4eee-b331-6d52760d2ba1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:48.010036 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50840687-ed8c-4eee-b331-6d52760d2ba1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:48.010036 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50840687-ed8c-4eee-b331-6d52760d2ba1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:48.152409 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-50840687-ed8c-4eee-b331-6d52760d2ba1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:48.160174 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-50840687-ed8c-4eee-b331-6d52760d2ba1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.166358 Jul 14 11:46:48.160933 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 155/347] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:47 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:48.194073 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2bea5662-202f-41b9-b881-a4677ef81b1c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:48.195312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2bea5662-202f-41b9-b881-a4677ef81b1c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:48.206350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2bea5662-202f-41b9-b881-a4677ef81b1c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:48.206951 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2bea5662-202f-41b9-b881-a4677ef81b1c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:48.207853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2bea5662-202f-41b9-b881-a4677ef81b1c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:48.208396 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2bea5662-202f-41b9-b881-a4677ef81b1c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:48.268091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-07dc3a6a-404e-4464-8936-689a98b00d3c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:48.268716 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-07dc3a6a-404e-4464-8936-689a98b00d3c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:48.284767 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-07dc3a6a-404e-4464-8936-689a98b00d3c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:48.285382 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-07dc3a6a-404e-4464-8936-689a98b00d3c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:48.286019 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-07dc3a6a-404e-4464-8936-689a98b00d3c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:48.286455 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-07dc3a6a-404e-4464-8936-689a98b00d3c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:48.368588 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2bea5662-202f-41b9-b881-a4677ef81b1c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:48.376803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2bea5662-202f-41b9-b881-a4677ef81b1c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.186561 Jul 14 11:46:48.377418 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 193/348] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:48 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:48.392686 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-85a1b596-9c29-49ad-bfee-8123d41597a9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:48.400375 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-85a1b596-9c29-49ad-bfee-8123d41597a9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:48.407406 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85a1b596-9c29-49ad-bfee-8123d41597a9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:48.407947 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85a1b596-9c29-49ad-bfee-8123d41597a9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:48.408920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85a1b596-9c29-49ad-bfee-8123d41597a9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:48.409401 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85a1b596-9c29-49ad-bfee-8123d41597a9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:48.452165 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-07dc3a6a-404e-4464-8936-689a98b00d3c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:48.460979 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-07dc3a6a-404e-4464-8936-689a98b00d3c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.196682 Jul 14 11:46:48.463471 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 156/349] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:48 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:48.553557 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-85a1b596-9c29-49ad-bfee-8123d41597a9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:48.562508 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-85a1b596-9c29-49ad-bfee-8123d41597a9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:48.564022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-85a1b596-9c29-49ad-bfee-8123d41597a9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:48.565550 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-85a1b596-9c29-49ad-bfee-8123d41597a9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.176965 Jul 14 11:46:48.566111 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 194/350] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:48 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:49.177193 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-fd7f064c-cc6b-497f-9076-f9e0bbc4f053 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:49.177750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-fd7f064c-cc6b-497f-9076-f9e0bbc4f053 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:49.184136 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fd7f064c-cc6b-497f-9076-f9e0bbc4f053 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:49.184586 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fd7f064c-cc6b-497f-9076-f9e0bbc4f053 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:49.185430 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fd7f064c-cc6b-497f-9076-f9e0bbc4f053 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:49.185841 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fd7f064c-cc6b-497f-9076-f9e0bbc4f053 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:49.327811 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-fd7f064c-cc6b-497f-9076-f9e0bbc4f053 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:49.336228 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-fd7f064c-cc6b-497f-9076-f9e0bbc4f053 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.162923 Jul 14 11:46:49.337106 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 157/351] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:49 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:49.394288 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f4660ce1-9ed0-49be-8b2e-87c42a1c01db tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:49.394982 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f4660ce1-9ed0-49be-8b2e-87c42a1c01db tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:49.402251 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f4660ce1-9ed0-49be-8b2e-87c42a1c01db tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:49.402811 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f4660ce1-9ed0-49be-8b2e-87c42a1c01db tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:49.403704 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f4660ce1-9ed0-49be-8b2e-87c42a1c01db tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:49.404678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f4660ce1-9ed0-49be-8b2e-87c42a1c01db tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:49.478748 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-db8ae1f2-7fd8-411a-9b41-bf7897724c7c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:49.479215 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-db8ae1f2-7fd8-411a-9b41-bf7897724c7c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:49.487031 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-db8ae1f2-7fd8-411a-9b41-bf7897724c7c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:49.487630 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-db8ae1f2-7fd8-411a-9b41-bf7897724c7c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:49.488602 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-db8ae1f2-7fd8-411a-9b41-bf7897724c7c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:49.489130 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-db8ae1f2-7fd8-411a-9b41-bf7897724c7c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:49.594721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f4660ce1-9ed0-49be-8b2e-87c42a1c01db tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:49.603421 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f4660ce1-9ed0-49be-8b2e-87c42a1c01db tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.213008 Jul 14 11:46:49.604787 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 195/352] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:49 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:49.615691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a57b17f9-b7c0-4728-88bf-3ff43500ea2a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:49.616423 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a57b17f9-b7c0-4728-88bf-3ff43500ea2a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:49.624182 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a57b17f9-b7c0-4728-88bf-3ff43500ea2a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:49.625024 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a57b17f9-b7c0-4728-88bf-3ff43500ea2a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:49.625963 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a57b17f9-b7c0-4728-88bf-3ff43500ea2a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:49.626542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a57b17f9-b7c0-4728-88bf-3ff43500ea2a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:49.670351 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-db8ae1f2-7fd8-411a-9b41-bf7897724c7c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:49.678481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-db8ae1f2-7fd8-411a-9b41-bf7897724c7c tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.204095 Jul 14 11:46:49.679332 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 158/353] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:49 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:49.794924 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a57b17f9-b7c0-4728-88bf-3ff43500ea2a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:49.804241 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a57b17f9-b7c0-4728-88bf-3ff43500ea2a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:49.805869 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a57b17f9-b7c0-4728-88bf-3ff43500ea2a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:49.807063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a57b17f9-b7c0-4728-88bf-3ff43500ea2a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.201082 Jul 14 11:46:49.807639 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 196/354] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:49 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:50.355449 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a8688bd9-e20b-4b17-b271-4e1390bd5a5b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:50.356046 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a8688bd9-e20b-4b17-b271-4e1390bd5a5b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:50.362853 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a8688bd9-e20b-4b17-b271-4e1390bd5a5b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:50.364913 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a8688bd9-e20b-4b17-b271-4e1390bd5a5b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:50.364913 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a8688bd9-e20b-4b17-b271-4e1390bd5a5b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:50.364913 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a8688bd9-e20b-4b17-b271-4e1390bd5a5b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:50.505574 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a8688bd9-e20b-4b17-b271-4e1390bd5a5b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:50.516478 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a8688bd9-e20b-4b17-b271-4e1390bd5a5b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.165043 Jul 14 11:46:50.517363 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 159/355] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:50 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:50.620543 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2d6200b5-782d-40cb-854a-711d970e31eb tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:50.621122 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2d6200b5-782d-40cb-854a-711d970e31eb tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:50.627872 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2d6200b5-782d-40cb-854a-711d970e31eb tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:50.628323 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2d6200b5-782d-40cb-854a-711d970e31eb tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:50.629122 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2d6200b5-782d-40cb-854a-711d970e31eb tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:50.629589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2d6200b5-782d-40cb-854a-711d970e31eb tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:50.695866 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e623ee05-d46c-43c0-830d-864914ed0cce tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:50.696522 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e623ee05-d46c-43c0-830d-864914ed0cce tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:50.703602 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e623ee05-d46c-43c0-830d-864914ed0cce tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:50.704299 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e623ee05-d46c-43c0-830d-864914ed0cce tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:50.705270 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e623ee05-d46c-43c0-830d-864914ed0cce tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:50.705991 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e623ee05-d46c-43c0-830d-864914ed0cce tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:50.800869 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2d6200b5-782d-40cb-854a-711d970e31eb tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:50.806541 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2d6200b5-782d-40cb-854a-711d970e31eb tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.190031 Jul 14 11:46:50.807516 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 197/356] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:50 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:50.824967 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-31c85dfb-963d-4bcf-b288-241f820b20ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:50.825629 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-31c85dfb-963d-4bcf-b288-241f820b20ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:50.832448 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-31c85dfb-963d-4bcf-b288-241f820b20ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:50.832957 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-31c85dfb-963d-4bcf-b288-241f820b20ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:50.834098 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-31c85dfb-963d-4bcf-b288-241f820b20ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:50.834223 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-31c85dfb-963d-4bcf-b288-241f820b20ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:50.864351 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e623ee05-d46c-43c0-830d-864914ed0cce tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:50.877001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e623ee05-d46c-43c0-830d-864914ed0cce tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.185199 Jul 14 11:46:50.878186 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 160/357] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:50 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:50.978952 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-31c85dfb-963d-4bcf-b288-241f820b20ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:50.990383 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-31c85dfb-963d-4bcf-b288-241f820b20ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:50.992005 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-31c85dfb-963d-4bcf-b288-241f820b20ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:50.994367 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-31c85dfb-963d-4bcf-b288-241f820b20ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.173239 Jul 14 11:46:50.995209 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 198/358] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:50 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:46:51.534403 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4632e66a-b0de-4b44-922b-0c41b631f37c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:51.535841 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-4632e66a-b0de-4b44-922b-0c41b631f37c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:51.543501 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4632e66a-b0de-4b44-922b-0c41b631f37c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:51.551331 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4632e66a-b0de-4b44-922b-0c41b631f37c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:51.551331 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4632e66a-b0de-4b44-922b-0c41b631f37c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:51.551331 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4632e66a-b0de-4b44-922b-0c41b631f37c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:51.685671 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-4632e66a-b0de-4b44-922b-0c41b631f37c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:51.693866 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-4632e66a-b0de-4b44-922b-0c41b631f37c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.163523 Jul 14 11:46:51.694450 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 161/359] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:51 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:51.823775 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ed26caa4-cb57-45ae-8d6d-168b910f6080 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:51.824586 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ed26caa4-cb57-45ae-8d6d-168b910f6080 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:51.833375 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ed26caa4-cb57-45ae-8d6d-168b910f6080 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:51.834247 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ed26caa4-cb57-45ae-8d6d-168b910f6080 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:51.835181 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ed26caa4-cb57-45ae-8d6d-168b910f6080 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:51.835621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ed26caa4-cb57-45ae-8d6d-168b910f6080 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:51.903059 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-cdcda6b3-52da-48f4-98ac-5a3821d700bd tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:51.903828 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-cdcda6b3-52da-48f4-98ac-5a3821d700bd tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:51.910768 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cdcda6b3-52da-48f4-98ac-5a3821d700bd tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:51.911918 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cdcda6b3-52da-48f4-98ac-5a3821d700bd tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:51.912131 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cdcda6b3-52da-48f4-98ac-5a3821d700bd tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:51.912635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cdcda6b3-52da-48f4-98ac-5a3821d700bd tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:52.000548 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ed26caa4-cb57-45ae-8d6d-168b910f6080 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:52.015079 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ed26caa4-cb57-45ae-8d6d-168b910f6080 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.195029 Jul 14 11:46:52.024601 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 199/360] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:51 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:52.032282 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d5a8c5a4-86aa-47ed-9bd7-aa95c894e0e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:52.032282 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d5a8c5a4-86aa-47ed-9bd7-aa95c894e0e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:52.037252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5a8c5a4-86aa-47ed-9bd7-aa95c894e0e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:52.037700 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5a8c5a4-86aa-47ed-9bd7-aa95c894e0e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:52.038478 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5a8c5a4-86aa-47ed-9bd7-aa95c894e0e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:52.038925 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5a8c5a4-86aa-47ed-9bd7-aa95c894e0e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:52.071120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-cdcda6b3-52da-48f4-98ac-5a3821d700bd tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:52.074658 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=100 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:52.099984 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-cdcda6b3-52da-48f4-98ac-5a3821d700bd tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.200941 Jul 14 11:46:52.106147 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 162/361] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:51 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:52.183159 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d5a8c5a4-86aa-47ed-9bd7-aa95c894e0e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:52.192175 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d5a8c5a4-86aa-47ed-9bd7-aa95c894e0e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:52.193747 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d5a8c5a4-86aa-47ed-9bd7-aa95c894e0e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:52.194914 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d5a8c5a4-86aa-47ed-9bd7-aa95c894e0e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.169231 Jul 14 11:46:52.195631 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 200/362] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:52 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:52.711414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-0ff5204b-fa01-4d56-af54-cdcfca077f5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:52.712028 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-0ff5204b-fa01-4d56-af54-cdcfca077f5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:52.719329 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0ff5204b-fa01-4d56-af54-cdcfca077f5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:52.719768 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0ff5204b-fa01-4d56-af54-cdcfca077f5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:52.720531 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0ff5204b-fa01-4d56-af54-cdcfca077f5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:52.720962 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0ff5204b-fa01-4d56-af54-cdcfca077f5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:52.860084 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-0ff5204b-fa01-4d56-af54-cdcfca077f5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:52.870092 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-0ff5204b-fa01-4d56-af54-cdcfca077f5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.162526 Jul 14 11:46:52.873543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 163/363] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:52 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:53.032370 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-cdba5011-d178-448e-b6d4-d0c633b797a6 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:53.033680 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-cdba5011-d178-448e-b6d4-d0c633b797a6 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:53.040021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cdba5011-d178-448e-b6d4-d0c633b797a6 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:53.040512 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cdba5011-d178-448e-b6d4-d0c633b797a6 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:53.041252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cdba5011-d178-448e-b6d4-d0c633b797a6 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:53.041687 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cdba5011-d178-448e-b6d4-d0c633b797a6 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:53.116955 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-954ed9f9-2aa7-40be-972b-faaaecac95f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:53.117601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-954ed9f9-2aa7-40be-972b-faaaecac95f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:53.135027 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-954ed9f9-2aa7-40be-972b-faaaecac95f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:53.135471 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-954ed9f9-2aa7-40be-972b-faaaecac95f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:53.136241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-954ed9f9-2aa7-40be-972b-faaaecac95f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:53.136671 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-954ed9f9-2aa7-40be-972b-faaaecac95f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:53.201950 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-cdba5011-d178-448e-b6d4-d0c633b797a6 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:53.210066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-cdba5011-d178-448e-b6d4-d0c633b797a6 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.181963 Jul 14 11:46:53.219882 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 201/364] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:53 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:53.224887 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3bd52391-9288-4c08-bf05-f71a4debe8c8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:53.225532 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3bd52391-9288-4c08-bf05-f71a4debe8c8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:53.231992 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3bd52391-9288-4c08-bf05-f71a4debe8c8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:53.232989 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3bd52391-9288-4c08-bf05-f71a4debe8c8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:53.233811 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3bd52391-9288-4c08-bf05-f71a4debe8c8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:53.234218 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3bd52391-9288-4c08-bf05-f71a4debe8c8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:53.296015 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-954ed9f9-2aa7-40be-972b-faaaecac95f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:53.304408 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-954ed9f9-2aa7-40be-972b-faaaecac95f0 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.191588 Jul 14 11:46:53.305001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 164/365] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:53 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:53.403566 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3bd52391-9288-4c08-bf05-f71a4debe8c8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:53.413406 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3bd52391-9288-4c08-bf05-f71a4debe8c8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:53.414972 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3bd52391-9288-4c08-bf05-f71a4debe8c8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:53.416161 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3bd52391-9288-4c08-bf05-f71a4debe8c8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.195200 Jul 14 11:46:53.416725 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 202/366] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:53 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:53.894066 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-58c29f69-ea9d-4229-8237-01252265a8a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:53.894066 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-58c29f69-ea9d-4229-8237-01252265a8a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:53.896059 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-58c29f69-ea9d-4229-8237-01252265a8a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:53.896588 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-58c29f69-ea9d-4229-8237-01252265a8a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:53.897366 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-58c29f69-ea9d-4229-8237-01252265a8a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:53.897813 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-58c29f69-ea9d-4229-8237-01252265a8a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:54.078828 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-58c29f69-ea9d-4229-8237-01252265a8a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:54.086776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-58c29f69-ea9d-4229-8237-01252265a8a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.202896 Jul 14 11:46:54.087367 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 165/367] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:53 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:54.231286 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5a7c8082-c83d-4a0f-94fd-7249402a3bf7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:54.231939 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-5a7c8082-c83d-4a0f-94fd-7249402a3bf7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:54.238904 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5a7c8082-c83d-4a0f-94fd-7249402a3bf7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:54.239340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5a7c8082-c83d-4a0f-94fd-7249402a3bf7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:54.240240 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5a7c8082-c83d-4a0f-94fd-7249402a3bf7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:54.250625 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5a7c8082-c83d-4a0f-94fd-7249402a3bf7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:54.321898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-7d91785f-3a78-4045-b7cc-3be933cd07ee tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:54.333828 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-7d91785f-3a78-4045-b7cc-3be933cd07ee tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:54.333828 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7d91785f-3a78-4045-b7cc-3be933cd07ee tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:54.333828 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7d91785f-3a78-4045-b7cc-3be933cd07ee tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:54.333828 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7d91785f-3a78-4045-b7cc-3be933cd07ee tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:54.334778 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7d91785f-3a78-4045-b7cc-3be933cd07ee tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:54.423076 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-5a7c8082-c83d-4a0f-94fd-7249402a3bf7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:54.432581 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-5a7c8082-c83d-4a0f-94fd-7249402a3bf7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.205182 Jul 14 11:46:54.442548 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 203/368] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:54 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:54.442890 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-261b6fea-efb7-4753-a77d-fdebc6dc9d27 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:54.443681 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-261b6fea-efb7-4753-a77d-fdebc6dc9d27 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:54.450187 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-261b6fea-efb7-4753-a77d-fdebc6dc9d27 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:54.450646 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-261b6fea-efb7-4753-a77d-fdebc6dc9d27 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:54.452129 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-261b6fea-efb7-4753-a77d-fdebc6dc9d27 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:54.452568 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-261b6fea-efb7-4753-a77d-fdebc6dc9d27 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:54.507823 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-7d91785f-3a78-4045-b7cc-3be933cd07ee tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:54.515976 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-7d91785f-3a78-4045-b7cc-3be933cd07ee tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.198081 Jul 14 11:46:54.519539 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 166/369] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:54 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:54.622664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-261b6fea-efb7-4753-a77d-fdebc6dc9d27 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:54.631678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-261b6fea-efb7-4753-a77d-fdebc6dc9d27 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:54.633338 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-261b6fea-efb7-4753-a77d-fdebc6dc9d27 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:54.634528 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-261b6fea-efb7-4753-a77d-fdebc6dc9d27 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.199369 Jul 14 11:46:54.635531 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 204/370] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:54 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:55.106580 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-8baf278a-3c00-4406-be50-84e904f42ca5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:55.107785 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-8baf278a-3c00-4406-be50-84e904f42ca5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:55.114195 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8baf278a-3c00-4406-be50-84e904f42ca5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:55.114650 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8baf278a-3c00-4406-be50-84e904f42ca5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:55.115428 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8baf278a-3c00-4406-be50-84e904f42ca5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:55.115867 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8baf278a-3c00-4406-be50-84e904f42ca5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:55.261378 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8baf278a-3c00-4406-be50-84e904f42ca5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:55.271538 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-8baf278a-3c00-4406-be50-84e904f42ca5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.168704 Jul 14 11:46:55.272410 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 167/371] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:55 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:55.450224 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ad095559-f258-41ac-a106-5088c8b63e82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:55.451494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ad095559-f258-41ac-a106-5088c8b63e82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:55.458649 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ad095559-f258-41ac-a106-5088c8b63e82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:55.459093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ad095559-f258-41ac-a106-5088c8b63e82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:55.459915 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ad095559-f258-41ac-a106-5088c8b63e82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:55.460342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ad095559-f258-41ac-a106-5088c8b63e82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:55.532993 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-39b7ae20-9022-4e34-85e7-894ab4c1add6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:55.533770 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-39b7ae20-9022-4e34-85e7-894ab4c1add6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:55.540180 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-39b7ae20-9022-4e34-85e7-894ab4c1add6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:55.540645 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-39b7ae20-9022-4e34-85e7-894ab4c1add6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:55.541501 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-39b7ae20-9022-4e34-85e7-894ab4c1add6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:55.542455 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-39b7ae20-9022-4e34-85e7-894ab4c1add6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:55.603400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ad095559-f258-41ac-a106-5088c8b63e82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:55.613748 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ad095559-f258-41ac-a106-5088c8b63e82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.167474 Jul 14 11:46:55.614894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 205/372] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:55 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:55.652077 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9cb09825-e268-4707-a45b-43e1823f9141 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:55.652886 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9cb09825-e268-4707-a45b-43e1823f9141 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:55.659108 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cb09825-e268-4707-a45b-43e1823f9141 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:55.659701 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cb09825-e268-4707-a45b-43e1823f9141 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:55.660568 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cb09825-e268-4707-a45b-43e1823f9141 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:55.661083 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cb09825-e268-4707-a45b-43e1823f9141 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:55.692895 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-39b7ae20-9022-4e34-85e7-894ab4c1add6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:55.700821 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-39b7ae20-9022-4e34-85e7-894ab4c1add6 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.171615 Jul 14 11:46:55.701542 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 168/373] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:55 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:55.808262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9cb09825-e268-4707-a45b-43e1823f9141 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:55.812815 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=100 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:55.817921 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9cb09825-e268-4707-a45b-43e1823f9141 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:55.822596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9cb09825-e268-4707-a45b-43e1823f9141 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:55.822596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9cb09825-e268-4707-a45b-43e1823f9141 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.172730 Jul 14 11:46:55.822596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 206/374] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:55 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:46:56.289140 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d5334130-7687-4a2e-a620-0534a7cff0ef tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:56.289850 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d5334130-7687-4a2e-a620-0534a7cff0ef tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:56.296426 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5334130-7687-4a2e-a620-0534a7cff0ef tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:56.296872 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5334130-7687-4a2e-a620-0534a7cff0ef tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:56.297681 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5334130-7687-4a2e-a620-0534a7cff0ef tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:56.298126 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5334130-7687-4a2e-a620-0534a7cff0ef tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:56.430809 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d5334130-7687-4a2e-a620-0534a7cff0ef tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:56.438461 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d5334130-7687-4a2e-a620-0534a7cff0ef tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.153268 Jul 14 11:46:56.441381 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 169/375] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:56 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:56.631164 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-25025708-a784-4fd5-a218-b381ea8d818f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:56.631768 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-25025708-a784-4fd5-a218-b381ea8d818f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:56.638390 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-25025708-a784-4fd5-a218-b381ea8d818f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:56.638830 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-25025708-a784-4fd5-a218-b381ea8d818f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:56.639589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-25025708-a784-4fd5-a218-b381ea8d818f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:56.640020 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-25025708-a784-4fd5-a218-b381ea8d818f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:56.717955 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-f23092ee-99b2-4c46-82c3-d7839c64c8af tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:56.718576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-f23092ee-99b2-4c46-82c3-d7839c64c8af tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:56.724779 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f23092ee-99b2-4c46-82c3-d7839c64c8af tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:56.725254 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f23092ee-99b2-4c46-82c3-d7839c64c8af tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:56.726028 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f23092ee-99b2-4c46-82c3-d7839c64c8af tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:56.726459 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f23092ee-99b2-4c46-82c3-d7839c64c8af tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:56.776712 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-25025708-a784-4fd5-a218-b381ea8d818f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:56.785825 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-25025708-a784-4fd5-a218-b381ea8d818f tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1260 microversion: 2.1 time: 0.157610 Jul 14 11:46:56.787869 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 207/376] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:56 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:56.838056 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b9e8dbe3-0abd-43b5-9b3b-05eca5597bf1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:56.838895 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b9e8dbe3-0abd-43b5-9b3b-05eca5597bf1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:56.846583 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b9e8dbe3-0abd-43b5-9b3b-05eca5597bf1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:56.847140 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b9e8dbe3-0abd-43b5-9b3b-05eca5597bf1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:56.847986 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b9e8dbe3-0abd-43b5-9b3b-05eca5597bf1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:56.848415 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b9e8dbe3-0abd-43b5-9b3b-05eca5597bf1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:57.015070 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b9e8dbe3-0abd-43b5-9b3b-05eca5597bf1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:57.024695 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b9e8dbe3-0abd-43b5-9b3b-05eca5597bf1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:57.026599 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b9e8dbe3-0abd-43b5-9b3b-05eca5597bf1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:57.027829 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b9e8dbe3-0abd-43b5-9b3b-05eca5597bf1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.193791 Jul 14 11:46:57.028398 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 208/377] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:56 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:46:57.184423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f23092ee-99b2-4c46-82c3-d7839c64c8af tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:57.192336 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-f23092ee-99b2-4c46-82c3-d7839c64c8af tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.478816 Jul 14 11:46:57.196657 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 170/378] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:56 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:46:57.456588 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6ed2a8ae-c1f4-4920-bd14-022c09a52e89 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:57.457223 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6ed2a8ae-c1f4-4920-bd14-022c09a52e89 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:57.463482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6ed2a8ae-c1f4-4920-bd14-022c09a52e89 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:57.463931 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6ed2a8ae-c1f4-4920-bd14-022c09a52e89 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:57.464711 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6ed2a8ae-c1f4-4920-bd14-022c09a52e89 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:57.465149 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6ed2a8ae-c1f4-4920-bd14-022c09a52e89 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:57.600339 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6ed2a8ae-c1f4-4920-bd14-022c09a52e89 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:57.607983 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6ed2a8ae-c1f4-4920-bd14-022c09a52e89 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.155563 Jul 14 11:46:57.608702 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 209/379] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:57 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:57.802939 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a772f0cc-1637-4c74-94d2-4e5c4d560e87 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:57.803740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a772f0cc-1637-4c74-94d2-4e5c4d560e87 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:57.807339 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=100 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:46:57.811662 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a772f0cc-1637-4c74-94d2-4e5c4d560e87 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:57.812113 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a772f0cc-1637-4c74-94d2-4e5c4d560e87 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:57.812883 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a772f0cc-1637-4c74-94d2-4e5c4d560e87 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:57.813373 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a772f0cc-1637-4c74-94d2-4e5c4d560e87 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:57.952679 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a772f0cc-1637-4c74-94d2-4e5c4d560e87 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:57.960371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a772f0cc-1637-4c74-94d2-4e5c4d560e87 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1445 microversion: 2.1 time: 0.161309 Jul 14 11:46:57.960951 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 171/380] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:57 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1445 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:57.976972 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9809c6c2-3075-4567-bacc-22e8900086be tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:57.977731 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9809c6c2-3075-4567-bacc-22e8900086be tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:57.984404 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9809c6c2-3075-4567-bacc-22e8900086be tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:57.984852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9809c6c2-3075-4567-bacc-22e8900086be tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:57.985676 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9809c6c2-3075-4567-bacc-22e8900086be tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:57.986116 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9809c6c2-3075-4567-bacc-22e8900086be tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:58.047765 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-68013aec-e60e-48e6-9ad1-f39698feb340 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:58.048287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-68013aec-e60e-48e6-9ad1-f39698feb340 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:58.054462 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-68013aec-e60e-48e6-9ad1-f39698feb340 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:58.054902 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-68013aec-e60e-48e6-9ad1-f39698feb340 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:58.055663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-68013aec-e60e-48e6-9ad1-f39698feb340 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:58.056090 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-68013aec-e60e-48e6-9ad1-f39698feb340 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:58.121703 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9809c6c2-3075-4567-bacc-22e8900086be tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:58.129419 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9809c6c2-3075-4567-bacc-22e8900086be tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1445 microversion: 2.1 time: 0.156258 Jul 14 11:46:58.129987 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 210/381] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:57 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:58.201753 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-68013aec-e60e-48e6-9ad1-f39698feb340 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:58.210478 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-68013aec-e60e-48e6-9ad1-f39698feb340 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:58.211987 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-68013aec-e60e-48e6-9ad1-f39698feb340 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:58.213140 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-68013aec-e60e-48e6-9ad1-f39698feb340 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.170058 Jul 14 11:46:58.213722 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 172/382] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:58 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:46:58.218585 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f25597c2-551a-4aff-8a8c-9a72ac2e22a7 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:58.219191 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f25597c2-551a-4aff-8a8c-9a72ac2e22a7 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:58.225105 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f25597c2-551a-4aff-8a8c-9a72ac2e22a7 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:58.225577 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f25597c2-551a-4aff-8a8c-9a72ac2e22a7 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:58.226330 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f25597c2-551a-4aff-8a8c-9a72ac2e22a7 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:58.226757 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f25597c2-551a-4aff-8a8c-9a72ac2e22a7 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:58.385313 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f25597c2-551a-4aff-8a8c-9a72ac2e22a7 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:58.393722 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f25597c2-551a-4aff-8a8c-9a72ac2e22a7 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.178760 Jul 14 11:46:58.395154 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 211/383] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:58 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:58.625890 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-174869ae-d4d0-4793-ac33-29075f97bbd3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:58.626589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-174869ae-d4d0-4793-ac33-29075f97bbd3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:58.632726 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-174869ae-d4d0-4793-ac33-29075f97bbd3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:58.633185 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-174869ae-d4d0-4793-ac33-29075f97bbd3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:58.633964 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-174869ae-d4d0-4793-ac33-29075f97bbd3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:58.634402 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-174869ae-d4d0-4793-ac33-29075f97bbd3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:58.845116 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-174869ae-d4d0-4793-ac33-29075f97bbd3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:58.852744 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-174869ae-d4d0-4793-ac33-29075f97bbd3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.231325 Jul 14 11:46:58.858014 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 173/384] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:58 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:59.230915 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-27e62e57-53c3-49d7-bf0a-22d73922f12f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:59.231479 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-27e62e57-53c3-49d7-bf0a-22d73922f12f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:59.238027 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-27e62e57-53c3-49d7-bf0a-22d73922f12f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:59.240619 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-27e62e57-53c3-49d7-bf0a-22d73922f12f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:59.240619 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-27e62e57-53c3-49d7-bf0a-22d73922f12f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:59.240619 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-27e62e57-53c3-49d7-bf0a-22d73922f12f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:59.374448 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-27e62e57-53c3-49d7-bf0a-22d73922f12f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:59.383138 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-27e62e57-53c3-49d7-bf0a-22d73922f12f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:59.384698 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-27e62e57-53c3-49d7-bf0a-22d73922f12f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:59.385904 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-27e62e57-53c3-49d7-bf0a-22d73922f12f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.159019 Jul 14 11:46:59.386460 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 212/385] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:46:59 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:46:59.410454 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-2fc94a48-9d32-4e01-99ad-51f2eec260c1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:59.417631 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-2fc94a48-9d32-4e01-99ad-51f2eec260c1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:59.417631 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2fc94a48-9d32-4e01-99ad-51f2eec260c1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:59.417855 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2fc94a48-9d32-4e01-99ad-51f2eec260c1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:59.418610 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2fc94a48-9d32-4e01-99ad-51f2eec260c1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:59.419045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2fc94a48-9d32-4e01-99ad-51f2eec260c1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:59.627328 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-2fc94a48-9d32-4e01-99ad-51f2eec260c1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:46:59.634897 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-2fc94a48-9d32-4e01-99ad-51f2eec260c1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.228306 Jul 14 11:46:59.646825 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 174/386] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:59 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:46:59.870470 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7e540690-289f-4eb0-abe0-2f172186940b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:46:59.875778 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7e540690-289f-4eb0-abe0-2f172186940b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:46:59.879757 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7e540690-289f-4eb0-abe0-2f172186940b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:59.880409 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7e540690-289f-4eb0-abe0-2f172186940b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:46:59.881239 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7e540690-289f-4eb0-abe0-2f172186940b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:46:59.881684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7e540690-289f-4eb0-abe0-2f172186940b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:00.029356 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7e540690-289f-4eb0-abe0-2f172186940b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:00.040934 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7e540690-289f-4eb0-abe0-2f172186940b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.174225 Jul 14 11:47:00.041653 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 213/387] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:46:59 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:00.406820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-f198c56d-63d8-4a4c-8628-44b919876546 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:00.407452 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-f198c56d-63d8-4a4c-8628-44b919876546 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:00.414318 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f198c56d-63d8-4a4c-8628-44b919876546 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:00.414764 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f198c56d-63d8-4a4c-8628-44b919876546 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:00.415534 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f198c56d-63d8-4a4c-8628-44b919876546 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:00.415965 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f198c56d-63d8-4a4c-8628-44b919876546 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:00.648633 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-92ca5a51-fb64-4763-acbc-7e49ba4e68a6 req-04272499-f352-4ab3-9981-9641b007ea5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee797cbe-7b7e-4e87-9da7-0c628ae3ede1", "tag": "df04a441-a4c9-485f-845a-68acb74d2d4e"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:00.658237 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-92ca5a51-fb64-4763-acbc-7e49ba4e68a6 req-04272499-f352-4ab3-9981-9641b007ea5e service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:00.659024 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-92ca5a51-fb64-4763-acbc-7e49ba4e68a6 req-04272499-f352-4ab3-9981-9641b007ea5e service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:00.672954 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-92ca5a51-fb64-4763-acbc-7e49ba4e68a6 req-04272499-f352-4ab3-9981-9641b007ea5e service nova] Creating event network-changed:df04a441-a4c9-485f-845a-68acb74d2d4e for instance ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 on hv-cinder-84980 Jul 14 11:47:00.679621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-92ca5a51-fb64-4763-acbc-7e49ba4e68a6 req-04272499-f352-4ab3-9981-9641b007ea5e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034860 Jul 14 11:47:00.680807 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f198c56d-63d8-4a4c-8628-44b919876546 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:00.681582 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 214/388] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:47:00.690727 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d5a287f8-19b4-4d19-9f6f-2d2402e38e71 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:00.691750 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d5a287f8-19b4-4d19-9f6f-2d2402e38e71 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:00.692438 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f198c56d-63d8-4a4c-8628-44b919876546 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:00.694699 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f198c56d-63d8-4a4c-8628-44b919876546 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:00.696033 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-f198c56d-63d8-4a4c-8628-44b919876546 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.294260 Jul 14 11:47:00.696984 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 175/389] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:47:00 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:47:00.702755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5a287f8-19b4-4d19-9f6f-2d2402e38e71 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:00.704452 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5a287f8-19b4-4d19-9f6f-2d2402e38e71 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:00.706175 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5a287f8-19b4-4d19-9f6f-2d2402e38e71 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:00.706175 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5a287f8-19b4-4d19-9f6f-2d2402e38e71 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:00.854899 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d5a287f8-19b4-4d19-9f6f-2d2402e38e71 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:00.864204 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d5a287f8-19b4-4d19-9f6f-2d2402e38e71 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.180301 Jul 14 11:47:00.864808 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 215/390] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:00 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:01.060341 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c6db13ec-9a3a-412f-b571-27c73db5f1c1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:01.061139 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c6db13ec-9a3a-412f-b571-27c73db5f1c1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:01.069061 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c6db13ec-9a3a-412f-b571-27c73db5f1c1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:01.071187 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c6db13ec-9a3a-412f-b571-27c73db5f1c1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:01.073027 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c6db13ec-9a3a-412f-b571-27c73db5f1c1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:01.073027 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c6db13ec-9a3a-412f-b571-27c73db5f1c1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:01.237789 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-c6db13ec-9a3a-412f-b571-27c73db5f1c1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:01.245653 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c6db13ec-9a3a-412f-b571-27c73db5f1c1 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.190477 Jul 14 11:47:01.246252 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 176/391] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:01 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:01.716305 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7f6beb0e-c605-47f0-9ad0-9729a17a8526 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:01.716921 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7f6beb0e-c605-47f0-9ad0-9729a17a8526 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:01.722987 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7f6beb0e-c605-47f0-9ad0-9729a17a8526 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:01.723437 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7f6beb0e-c605-47f0-9ad0-9729a17a8526 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:01.724205 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7f6beb0e-c605-47f0-9ad0-9729a17a8526 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:01.724644 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7f6beb0e-c605-47f0-9ad0-9729a17a8526 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:01.861235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7f6beb0e-c605-47f0-9ad0-9729a17a8526 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:01.869806 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7f6beb0e-c605-47f0-9ad0-9729a17a8526 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:01.871333 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7f6beb0e-c605-47f0-9ad0-9729a17a8526 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:01.872497 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7f6beb0e-c605-47f0-9ad0-9729a17a8526 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.160353 Jul 14 11:47:01.873613 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 216/392] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:47:01 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:47:01.883882 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9d4734d3-4976-4d87-a9cd-d9eda0f0d479 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:01.884499 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9d4734d3-4976-4d87-a9cd-d9eda0f0d479 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:01.891759 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9d4734d3-4976-4d87-a9cd-d9eda0f0d479 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:01.892246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9d4734d3-4976-4d87-a9cd-d9eda0f0d479 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:01.893003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9d4734d3-4976-4d87-a9cd-d9eda0f0d479 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:01.893488 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9d4734d3-4976-4d87-a9cd-d9eda0f0d479 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:02.020264 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9d4734d3-4976-4d87-a9cd-d9eda0f0d479 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:02.028037 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9d4734d3-4976-4d87-a9cd-d9eda0f0d479 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.148055 Jul 14 11:47:02.028600 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 177/393] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:01 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:02.121255 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-cbf56a3c-636c-4c4d-a0f0-6f50645ad03f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:02.121752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-cbf56a3c-636c-4c4d-a0f0-6f50645ad03f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:02.127819 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cbf56a3c-636c-4c4d-a0f0-6f50645ad03f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:02.128273 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cbf56a3c-636c-4c4d-a0f0-6f50645ad03f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:02.129040 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cbf56a3c-636c-4c4d-a0f0-6f50645ad03f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:02.129505 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cbf56a3c-636c-4c4d-a0f0-6f50645ad03f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:02.253399 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-cbf56a3c-636c-4c4d-a0f0-6f50645ad03f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lazy-loading 'services' on Instance uuid 36228e4a-c9d6-4e57-81fe-e8a49d221573 {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:47:02.264293 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-98c3b225-6494-465e-9f0b-1dc09497de0e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:02.264912 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-98c3b225-6494-465e-9f0b-1dc09497de0e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:02.271008 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-98c3b225-6494-465e-9f0b-1dc09497de0e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:02.271462 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-98c3b225-6494-465e-9f0b-1dc09497de0e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:02.272225 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-98c3b225-6494-465e-9f0b-1dc09497de0e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:02.272701 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-98c3b225-6494-465e-9f0b-1dc09497de0e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:02.405091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-98c3b225-6494-465e-9f0b-1dc09497de0e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:02.412621 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-98c3b225-6494-465e-9f0b-1dc09497de0e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.152773 Jul 14 11:47:02.413207 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 178/394] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:02 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:02.561708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-cbf56a3c-636c-4c4d-a0f0-6f50645ad03f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "DELETE /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/os-volume_attachments/00a61e73-58f4-4072-9e86-0e137dafff06" status: 202 len: 0 microversion: 2.1 time: 0.444166 Jul 14 11:47:02.564323 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 217/395] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 11:47:02 2022] DELETE /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/os-volume_attachments/00a61e73-58f4-4072-9e86-0e137dafff06 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:47:02.890944 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ba0cda50-dea2-4e16-902d-a1638b9aa32d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:02.891565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ba0cda50-dea2-4e16-902d-a1638b9aa32d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:02.898099 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba0cda50-dea2-4e16-902d-a1638b9aa32d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:02.898548 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba0cda50-dea2-4e16-902d-a1638b9aa32d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:02.899606 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba0cda50-dea2-4e16-902d-a1638b9aa32d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:02.900040 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba0cda50-dea2-4e16-902d-a1638b9aa32d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:02.917849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=100 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:03.032213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ba0cda50-dea2-4e16-902d-a1638b9aa32d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:03.040916 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ba0cda50-dea2-4e16-902d-a1638b9aa32d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:03.042488 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ba0cda50-dea2-4e16-902d-a1638b9aa32d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:03.043664 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ba0cda50-dea2-4e16-902d-a1638b9aa32d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.157284 Jul 14 11:47:03.044216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 179/396] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:47:02 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:47:03.045965 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-21972d77-4dd1-4079-8d71-da6ba4adc063 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:03.046671 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-21972d77-4dd1-4079-8d71-da6ba4adc063 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:03.052921 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-21972d77-4dd1-4079-8d71-da6ba4adc063 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:03.053417 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-21972d77-4dd1-4079-8d71-da6ba4adc063 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:03.054196 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-21972d77-4dd1-4079-8d71-da6ba4adc063 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:03.054636 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-21972d77-4dd1-4079-8d71-da6ba4adc063 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:03.189213 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-21972d77-4dd1-4079-8d71-da6ba4adc063 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:03.196618 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-21972d77-4dd1-4079-8d71-da6ba4adc063 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.155381 Jul 14 11:47:03.197206 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 218/397] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:03 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:03.433774 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-21f7ade2-104a-4d2d-a66f-3d3f2e76cfa2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:03.433774 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-21f7ade2-104a-4d2d-a66f-3d3f2e76cfa2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:03.439486 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-21f7ade2-104a-4d2d-a66f-3d3f2e76cfa2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:03.441521 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-21f7ade2-104a-4d2d-a66f-3d3f2e76cfa2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:03.442303 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-21f7ade2-104a-4d2d-a66f-3d3f2e76cfa2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:03.442741 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-21f7ade2-104a-4d2d-a66f-3d3f2e76cfa2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:03.694998 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-21f7ade2-104a-4d2d-a66f-3d3f2e76cfa2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:03.702558 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-21f7ade2-104a-4d2d-a66f-3d3f2e76cfa2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1500 microversion: 2.1 time: 0.276034 Jul 14 11:47:03.703126 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 180/398] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:03 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1500 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:03.719048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-64118034-899a-442c-9051-cc390fcb1a24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce00e1cb-e2f4-4ac3-a4fa-295b66115dc3"}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:03.720173 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-64118034-899a-442c-9051-cc390fcb1a24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:03.726272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-64118034-899a-442c-9051-cc390fcb1a24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:03.726711 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-64118034-899a-442c-9051-cc390fcb1a24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:03.727464 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-64118034-899a-442c-9051-cc390fcb1a24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:03.727893 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-64118034-899a-442c-9051-cc390fcb1a24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:03.750928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-64118034-899a-442c-9051-cc390fcb1a24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] HTTP exception thrown: Cannot 'attach_volume' instance 336dc998-9572-45da-bf2b-b3490712426c while it is in vm_state rescued Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-64118034-899a-442c-9051-cc390fcb1a24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Request method failure captured: Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: POST /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c/os-volume_attachments HTTP/1.1 Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 74 Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AHQD1ds0B25g5a12RFZgJ1X93Ad5kZKaW0a1WjTLos6WW0CS6889iadn7zLg9bxO6vFXCGcHydQ85EksLgMo8lXHCJEJA7JIza9eewxu56JoCts8WylfsrATjwEt9XaewZT3n2T3tUxjz2Qgf3sANPTml-AV6YyBO2MzgTVNMnGeHI Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 951609a482e34e93908057a68c5dc706 Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-954968877 Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:47:03.753109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:47:03.754708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/951609a482e34e93908057a68c5dc706"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_951609a482e34e93908057a68c5dc706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/951609a482e34e93908057a68c5dc706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/951609a482e34e93908057a68c5dc706"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:47:03.754708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-ServerRescueNegativeTestJSON-954968877 Jul 14 11:47:03.754708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 951609a482e34e93908057a68c5dc706 Jul 14 11:47:03.754708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-954968877 Jul 14 11:47:03.754708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-ServerRescueNegativeTestJSON-954968877-project Jul 14 11:47:03.754708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:47:03.754708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:47:03.754708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 7bf3f705e04640a2a5d9bedb71c6ccb5 Jul 14 11:47:03.754708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-ServerRescueNegativeTestJSON-954968877-project Jul 14 11:47:03.754708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Jul 14 11:47:03.754708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {"volumeAttachment": {"volumeId": "ce00e1cb-e2f4-4ac3-a4fa-295b66115dc3"}} Jul 14 11:47:03.754708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Cannot 'attach_volume' instance 336dc998-9572-45da-bf2b-b3490712426c while it is in vm_state rescued Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'server_id': '336dc998-9572-45da-bf2b-b3490712426c', 'body': {'volumeAttachment': {'volumeId': 'ce00e1cb-e2f4-4ac3-a4fa-295b66115dc3'}}} Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 336dc998-9572-45da-bf2b-b3490712426c in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:47:03.755803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 336dc998-9572-45da-bf2b-b3490712426c while it is in vm_state rescued Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:47:03.757294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:47:03.758684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:47:03.758684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:47:03.758684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 336dc998-9572-45da-bf2b-b3490712426c while it is in vm_state rescued Jul 14 11:47:03.758684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:47:03.758684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-64118034-899a-442c-9051-cc390fcb1a24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Returning 409 to user: Cannot 'attach_volume' instance 336dc998-9572-45da-bf2b-b3490712426c while it is in vm_state rescued {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:47:03.758684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-64118034-899a-442c-9051-cc390fcb1a24 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "POST /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039970 Jul 14 11:47:03.758684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 219/399] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 11:47:03 2022] POST /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 11:47:03.764069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-cae450b6-81ef-4b3b-8fe3-bcb3800920e9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:03.764597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-cae450b6-81ef-4b3b-8fe3-bcb3800920e9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:03.770709 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cae450b6-81ef-4b3b-8fe3-bcb3800920e9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:03.771149 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cae450b6-81ef-4b3b-8fe3-bcb3800920e9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:03.771899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cae450b6-81ef-4b3b-8fe3-bcb3800920e9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:03.772328 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cae450b6-81ef-4b3b-8fe3-bcb3800920e9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:03.959240 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-cae450b6-81ef-4b3b-8fe3-bcb3800920e9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "POST /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c/action" status: 202 len: 0 microversion: 2.1 time: 0.199255 Jul 14 11:47:03.959985 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 181/400] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 11:47:03 2022] POST /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:47:03.968405 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8220f736-686c-47dd-aaa8-83b0657e5b4d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:03.970245 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-8220f736-686c-47dd-aaa8-83b0657e5b4d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:03.975148 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8220f736-686c-47dd-aaa8-83b0657e5b4d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:03.975601 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8220f736-686c-47dd-aaa8-83b0657e5b4d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:03.976386 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8220f736-686c-47dd-aaa8-83b0657e5b4d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:03.976975 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8220f736-686c-47dd-aaa8-83b0657e5b4d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:04.062786 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a187cbeb-a812-4857-93e3-2744408a7548 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:04.063521 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a187cbeb-a812-4857-93e3-2744408a7548 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:04.070144 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a187cbeb-a812-4857-93e3-2744408a7548 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:04.073328 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a187cbeb-a812-4857-93e3-2744408a7548 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:04.073328 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a187cbeb-a812-4857-93e3-2744408a7548 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:04.073328 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a187cbeb-a812-4857-93e3-2744408a7548 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:04.121704 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-8220f736-686c-47dd-aaa8-83b0657e5b4d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:04.130315 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-8220f736-686c-47dd-aaa8-83b0657e5b4d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1508 microversion: 2.1 time: 0.166291 Jul 14 11:47:04.131744 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 220/401] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:03 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:04.213489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9cdb3351-20ee-4b6b-93d0-a67c9520b104 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:04.214011 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9cdb3351-20ee-4b6b-93d0-a67c9520b104 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:04.220107 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cdb3351-20ee-4b6b-93d0-a67c9520b104 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:04.220556 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cdb3351-20ee-4b6b-93d0-a67c9520b104 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:04.221369 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cdb3351-20ee-4b6b-93d0-a67c9520b104 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:04.221810 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cdb3351-20ee-4b6b-93d0-a67c9520b104 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:04.335358 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a187cbeb-a812-4857-93e3-2744408a7548 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:04.345124 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a187cbeb-a812-4857-93e3-2744408a7548 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:04.346781 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a187cbeb-a812-4857-93e3-2744408a7548 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:04.348023 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a187cbeb-a812-4857-93e3-2744408a7548 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.290001 Jul 14 11:47:04.348668 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 182/402] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:47:04 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:47:04.353739 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-bd0f92d2-d44b-42c3-bbf3-78b2c80ebd73 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:04.354312 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-bd0f92d2-d44b-42c3-bbf3-78b2c80ebd73 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:04.360088 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9cdb3351-20ee-4b6b-93d0-a67c9520b104 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:04.360783 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bd0f92d2-d44b-42c3-bbf3-78b2c80ebd73 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:04.361146 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bd0f92d2-d44b-42c3-bbf3-78b2c80ebd73 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:04.361971 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bd0f92d2-d44b-42c3-bbf3-78b2c80ebd73 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:04.362411 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bd0f92d2-d44b-42c3-bbf3-78b2c80ebd73 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:04.368211 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9cdb3351-20ee-4b6b-93d0-a67c9520b104 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.158725 Jul 14 11:47:04.368783 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 221/403] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:04 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:04.387256 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-bd0f92d2-d44b-42c3-bbf3-78b2c80ebd73 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25/ips" status: 200 len: 151 microversion: 2.1 time: 0.037439 Jul 14 11:47:04.387877 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 183/404] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 11:47:04 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:47:04.399193 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2691931e-8531-4c16-8319-5e2ae8e4d27d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82c9edf1-12cf-4a6d-9e2b-976024f6c6e9"}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:04.400304 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2691931e-8531-4c16-8319-5e2ae8e4d27d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:04.406453 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2691931e-8531-4c16-8319-5e2ae8e4d27d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:04.406896 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2691931e-8531-4c16-8319-5e2ae8e4d27d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:04.407655 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2691931e-8531-4c16-8319-5e2ae8e4d27d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:04.408086 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2691931e-8531-4c16-8319-5e2ae8e4d27d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:04.488373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-2691931e-8531-4c16-8319-5e2ae8e4d27d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] HTTP exception thrown: Invalid volume: volume 82c9edf1-12cf-4a6d-9e2b-976024f6c6e9 is already attached to instances: edc1d8c0-48e2-49bd-8807-bb041db6a9df Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2691931e-8531-4c16-8319-5e2ae8e4d27d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Request method failure captured: Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: POST /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25/os-volume_attachments HTTP/1.1 Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 74 Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AGNrCXQELDmNK7QTgAsdlJtPBM_GXw3pFQ92I5FXg_Nl7xnN8erDQ0jD6cBgqZwNWgSGDIvH_OU-IJPWW0i2GmYKcnE8wD4a47a9DJeOO5JgDloTkiJ3A6EcxYhG-symYmW7J8b_ws3S47CzQaA9KAgAK_QrTjwz8qGsPABa7uBQLs Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:47:04.490022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:47:04.491589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f274d555f5c746cc885394c699b3d767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f274d555f5c746cc885394c699b3d767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:47:04.491589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:47:04.491589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:47:04.491589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:47:04.491589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:47:04.491589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:47:04.491589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:47:04.491589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 8773c88f88614a9d903f667305a217e0 Jul 14 11:47:04.491589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:47:04.491589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Jul 14 11:47:04.491589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {"volumeAttachment": {"volumeId": "82c9edf1-12cf-4a6d-9e2b-976024f6c6e9"}} Jul 14 11:47:04.491589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Invalid volume: volume 82c9edf1-12cf-4a6d-9e2b-976024f6c6e9 is already attached to instances: edc1d8c0-48e2-49bd-8807-bb041db6a9df Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'server_id': '3b863b39-54e7-4601-bb9b-d41e745f2e25', 'body': {'volumeAttachment': {'volumeId': '82c9edf1-12cf-4a6d-9e2b-976024f6c6e9'}}} Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 82c9edf1-12cf-4a6d-9e2b-976024f6c6e9 is already attached to instances: edc1d8c0-48e2-49bd-8807-bb041db6a9df Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:47:04.492482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 82c9edf1-12cf-4a6d-9e2b-976024f6c6e9 is already attached to instances: edc1d8c0-48e2-49bd-8807-bb041db6a9df Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:47:04.493956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:47:04.495364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:47:04.495364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:47:04.495364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:47:04.495364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 82c9edf1-12cf-4a6d-9e2b-976024f6c6e9 is already attached to instances: edc1d8c0-48e2-49bd-8807-bb041db6a9df Jul 14 11:47:04.495364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:47:04.495364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2691931e-8531-4c16-8319-5e2ae8e4d27d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Returning 400 to user: Invalid volume: volume 82c9edf1-12cf-4a6d-9e2b-976024f6c6e9 is already attached to instances: edc1d8c0-48e2-49bd-8807-bb041db6a9df {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:47:04.495364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2691931e-8531-4c16-8319-5e2ae8e4d27d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "POST /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096570 Jul 14 11:47:04.495364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 222/405] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 11:47:04 2022] POST /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:47:04.501718 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-dfa4ce97-87eb-40f3-b861-af65bdbd2c66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:04.502603 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-dfa4ce97-87eb-40f3-b861-af65bdbd2c66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:04.510310 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dfa4ce97-87eb-40f3-b861-af65bdbd2c66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:04.510763 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dfa4ce97-87eb-40f3-b861-af65bdbd2c66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:04.511549 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dfa4ce97-87eb-40f3-b861-af65bdbd2c66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:04.512002 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dfa4ce97-87eb-40f3-b861-af65bdbd2c66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:04.537440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-dfa4ce97-87eb-40f3-b861-af65bdbd2c66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Going to try to terminate instance {{(pid=124946) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:47:04.757601 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-1ec8bf91-eafc-403e-9b62-8d6000b872a3 req-6325b243-4337-473f-b416-2d8c70aab634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70b1731-0a31-4df3-99fe-42587445a297", "name": "network-vif-plugged", "status": "completed", "tag": "ba72d0b2-3ada-4475-825a-02b31c695891"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:04.764210 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=100 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:04.768533 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-1ec8bf91-eafc-403e-9b62-8d6000b872a3 req-6325b243-4337-473f-b416-2d8c70aab634 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:04.768995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-1ec8bf91-eafc-403e-9b62-8d6000b872a3 req-6325b243-4337-473f-b416-2d8c70aab634 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:04.780490 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-1ec8bf91-eafc-403e-9b62-8d6000b872a3 req-6325b243-4337-473f-b416-2d8c70aab634 service nova] Creating event network-vif-plugged:ba72d0b2-3ada-4475-825a-02b31c695891 for instance a70b1731-0a31-4df3-99fe-42587445a297 on hv-cinder-84980 Jul 14 11:47:04.785445 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-1ec8bf91-eafc-403e-9b62-8d6000b872a3 req-6325b243-4337-473f-b416-2d8c70aab634 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037798 Jul 14 11:47:04.786047 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 223/406] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:47:04.837185 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-dfa4ce97-87eb-40f3-b861-af65bdbd2c66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 204 len: 0 microversion: 2.1 time: 0.339637 Jul 14 11:47:04.837835 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 184/407] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:47:04 2022] DELETE /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:04.847158 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-39666c0b-043c-4e90-a9d9-f45ad15d5e5d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:04.847886 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-39666c0b-043c-4e90-a9d9-f45ad15d5e5d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:04.854766 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-39666c0b-043c-4e90-a9d9-f45ad15d5e5d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:04.855319 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-39666c0b-043c-4e90-a9d9-f45ad15d5e5d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:04.856095 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-39666c0b-043c-4e90-a9d9-f45ad15d5e5d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:04.856538 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-39666c0b-043c-4e90-a9d9-f45ad15d5e5d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:04.876241 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:04.989428 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-39666c0b-043c-4e90-a9d9-f45ad15d5e5d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:04.997079 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-39666c0b-043c-4e90-a9d9-f45ad15d5e5d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1681 microversion: 2.1 time: 0.154239 Jul 14 11:47:04.997681 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 224/408] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:04 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:05.148417 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-2a30ac0c-daae-435b-9cc2-7fbe30cbfeb0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:05.149413 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-2a30ac0c-daae-435b-9cc2-7fbe30cbfeb0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:05.156482 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2a30ac0c-daae-435b-9cc2-7fbe30cbfeb0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:05.156942 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2a30ac0c-daae-435b-9cc2-7fbe30cbfeb0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:05.157749 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2a30ac0c-daae-435b-9cc2-7fbe30cbfeb0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:05.158191 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2a30ac0c-daae-435b-9cc2-7fbe30cbfeb0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:05.367584 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2fb01233-2902-4243-a676-9eccad244ef3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:05.368643 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2fb01233-2902-4243-a676-9eccad244ef3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:05.370864 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-2a30ac0c-daae-435b-9cc2-7fbe30cbfeb0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:05.375252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2fb01233-2902-4243-a676-9eccad244ef3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:05.375451 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2fb01233-2902-4243-a676-9eccad244ef3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:05.376226 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2fb01233-2902-4243-a676-9eccad244ef3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:05.376664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2fb01233-2902-4243-a676-9eccad244ef3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:05.381699 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-2a30ac0c-daae-435b-9cc2-7fbe30cbfeb0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1508 microversion: 2.1 time: 0.237386 Jul 14 11:47:05.382287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 185/409] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:05 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:05.400523 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-789f2f8a-5495-493a-9669-1ff6a26662d1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:05.401135 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-789f2f8a-5495-493a-9669-1ff6a26662d1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:05.408722 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-789f2f8a-5495-493a-9669-1ff6a26662d1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:05.409290 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-789f2f8a-5495-493a-9669-1ff6a26662d1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:05.410294 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-789f2f8a-5495-493a-9669-1ff6a26662d1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:05.410734 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-789f2f8a-5495-493a-9669-1ff6a26662d1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:05.526665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2fb01233-2902-4243-a676-9eccad244ef3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:05.535980 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2fb01233-2902-4243-a676-9eccad244ef3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:05.537564 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2fb01233-2902-4243-a676-9eccad244ef3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:05.538722 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2fb01233-2902-4243-a676-9eccad244ef3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.175475 Jul 14 11:47:05.544388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 225/410] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:47:05 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:47:05.551532 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-789f2f8a-5495-493a-9669-1ff6a26662d1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:05.559341 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-789f2f8a-5495-493a-9669-1ff6a26662d1 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.175559 Jul 14 11:47:05.559897 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 186/411] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:05 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:06.014897 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-e0f9a665-5aee-4383-8556-348b010f9d08 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:06.015425 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-e0f9a665-5aee-4383-8556-348b010f9d08 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:06.021489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e0f9a665-5aee-4383-8556-348b010f9d08 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:06.021934 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e0f9a665-5aee-4383-8556-348b010f9d08 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:06.022691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e0f9a665-5aee-4383-8556-348b010f9d08 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:06.023124 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e0f9a665-5aee-4383-8556-348b010f9d08 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:06.152190 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e0f9a665-5aee-4383-8556-348b010f9d08 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:06.159620 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-e0f9a665-5aee-4383-8556-348b010f9d08 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1681 microversion: 2.1 time: 0.148681 Jul 14 11:47:06.160189 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 226/412] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:06 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:06.399947 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-8d70da0b-9bb6-424d-aefd-3199d8efd6d3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:06.400526 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-8d70da0b-9bb6-424d-aefd-3199d8efd6d3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:06.407659 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8d70da0b-9bb6-424d-aefd-3199d8efd6d3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:06.408112 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8d70da0b-9bb6-424d-aefd-3199d8efd6d3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:06.408871 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8d70da0b-9bb6-424d-aefd-3199d8efd6d3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:06.409351 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8d70da0b-9bb6-424d-aefd-3199d8efd6d3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:06.537433 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8d70da0b-9bb6-424d-aefd-3199d8efd6d3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:06.545570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-8d70da0b-9bb6-424d-aefd-3199d8efd6d3 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1508 microversion: 2.1 time: 0.149211 Jul 14 11:47:06.546147 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 187/413] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:06 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:06.560381 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-84078810-5cb0-464c-918b-f27a272b9d9e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:06.560992 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-84078810-5cb0-464c-918b-f27a272b9d9e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:06.567073 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-84078810-5cb0-464c-918b-f27a272b9d9e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:06.567522 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-84078810-5cb0-464c-918b-f27a272b9d9e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:06.568356 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-84078810-5cb0-464c-918b-f27a272b9d9e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:06.568789 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-84078810-5cb0-464c-918b-f27a272b9d9e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:06.576654 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a0a1ab1f-1de4-4c19-80fc-2a9ffcc0f3fb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:06.577651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a0a1ab1f-1de4-4c19-80fc-2a9ffcc0f3fb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:06.584813 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a0a1ab1f-1de4-4c19-80fc-2a9ffcc0f3fb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:06.585306 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a0a1ab1f-1de4-4c19-80fc-2a9ffcc0f3fb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:06.586085 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a0a1ab1f-1de4-4c19-80fc-2a9ffcc0f3fb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:06.588033 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a0a1ab1f-1de4-4c19-80fc-2a9ffcc0f3fb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:06.726252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-84078810-5cb0-464c-918b-f27a272b9d9e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:06.735508 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-84078810-5cb0-464c-918b-f27a272b9d9e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:06.737063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-84078810-5cb0-464c-918b-f27a272b9d9e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:06.738257 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-84078810-5cb0-464c-918b-f27a272b9d9e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.181991 Jul 14 11:47:06.738826 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 227/414] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:47:06 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:47:06.741093 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a0a1ab1f-1de4-4c19-80fc-2a9ffcc0f3fb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:06.748689 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a0a1ab1f-1de4-4c19-80fc-2a9ffcc0f3fb tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.176681 Jul 14 11:47:06.749276 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 188/415] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:06 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:07.177285 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-54690a23-cdc3-4bbf-8c9c-ae37f6937b4f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:07.178265 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-54690a23-cdc3-4bbf-8c9c-ae37f6937b4f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:07.186036 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-54690a23-cdc3-4bbf-8c9c-ae37f6937b4f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:07.189317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-54690a23-cdc3-4bbf-8c9c-ae37f6937b4f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:07.189317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-54690a23-cdc3-4bbf-8c9c-ae37f6937b4f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:07.189317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-54690a23-cdc3-4bbf-8c9c-ae37f6937b4f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:07.368839 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-54690a23-cdc3-4bbf-8c9c-ae37f6937b4f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:07.379196 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-54690a23-cdc3-4bbf-8c9c-ae37f6937b4f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1681 microversion: 2.1 time: 0.206905 Jul 14 11:47:07.380063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 228/416] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:07 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:07.562779 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-dc922f98-e9d2-456e-888f-6495041ae6da tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:07.563397 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-dc922f98-e9d2-456e-888f-6495041ae6da tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:07.570098 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dc922f98-e9d2-456e-888f-6495041ae6da tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:07.570553 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dc922f98-e9d2-456e-888f-6495041ae6da tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:07.571322 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dc922f98-e9d2-456e-888f-6495041ae6da tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:07.571761 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dc922f98-e9d2-456e-888f-6495041ae6da tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:07.701849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-dc922f98-e9d2-456e-888f-6495041ae6da tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:07.709407 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-dc922f98-e9d2-456e-888f-6495041ae6da tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1508 microversion: 2.1 time: 0.150940 Jul 14 11:47:07.709911 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 189/417] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:07 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:07.756770 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f381b2a6-ef57-4d08-89e1-c54a0b3af64d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:07.758420 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f381b2a6-ef57-4d08-89e1-c54a0b3af64d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:07.767054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f381b2a6-ef57-4d08-89e1-c54a0b3af64d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:07.767269 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d291e51a-196a-4e23-a8b8-28cab7de6898 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:07.767497 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f381b2a6-ef57-4d08-89e1-c54a0b3af64d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:07.768244 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d291e51a-196a-4e23-a8b8-28cab7de6898 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:07.768350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f381b2a6-ef57-4d08-89e1-c54a0b3af64d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:07.773368 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f381b2a6-ef57-4d08-89e1-c54a0b3af64d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:07.775371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d291e51a-196a-4e23-a8b8-28cab7de6898 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:07.776080 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d291e51a-196a-4e23-a8b8-28cab7de6898 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:07.777037 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d291e51a-196a-4e23-a8b8-28cab7de6898 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:07.778267 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d291e51a-196a-4e23-a8b8-28cab7de6898 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:08.000423 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f381b2a6-ef57-4d08-89e1-c54a0b3af64d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:08.010212 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f381b2a6-ef57-4d08-89e1-c54a0b3af64d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:08.011772 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f381b2a6-ef57-4d08-89e1-c54a0b3af64d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:08.012932 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f381b2a6-ef57-4d08-89e1-c54a0b3af64d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.260972 Jul 14 11:47:08.013542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 229/418] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:47:07 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:47:08.018800 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d36393c4-6900-41ca-9261-47f558c117dc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:08.025457 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d36393c4-6900-41ca-9261-47f558c117dc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:08.025905 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d36393c4-6900-41ca-9261-47f558c117dc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:08.050894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d36393c4-6900-41ca-9261-47f558c117dc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Going to try to stop instance {{(pid=124947) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 11:47:08.105591 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d291e51a-196a-4e23-a8b8-28cab7de6898 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:08.111953 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d291e51a-196a-4e23-a8b8-28cab7de6898 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.348424 Jul 14 11:47:08.112527 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 190/419] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:07 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:08.223032 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d36393c4-6900-41ca-9261-47f558c117dc tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "POST /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/action" status: 202 len: 0 microversion: 2.1 time: 0.208207 Jul 14 11:47:08.223667 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 230/420] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 11:47:08 2022] POST /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:47:08.231878 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-020c2790-5ffc-4b76-ba54-c71982714924 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:08.233037 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-020c2790-5ffc-4b76-ba54-c71982714924 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:08.239187 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-020c2790-5ffc-4b76-ba54-c71982714924 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:08.239641 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-020c2790-5ffc-4b76-ba54-c71982714924 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:08.240416 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-020c2790-5ffc-4b76-ba54-c71982714924 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:08.240855 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-020c2790-5ffc-4b76-ba54-c71982714924 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:08.400594 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6d2b43a2-0b3a-45a9-9ede-f97ef7ec5993 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:08.401755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6d2b43a2-0b3a-45a9-9ede-f97ef7ec5993 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:08.408960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6d2b43a2-0b3a-45a9-9ede-f97ef7ec5993 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:08.409499 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6d2b43a2-0b3a-45a9-9ede-f97ef7ec5993 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:08.410283 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6d2b43a2-0b3a-45a9-9ede-f97ef7ec5993 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:08.410722 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6d2b43a2-0b3a-45a9-9ede-f97ef7ec5993 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:08.511690 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-020c2790-5ffc-4b76-ba54-c71982714924 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:08.521621 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-020c2790-5ffc-4b76-ba54-c71982714924 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1678 microversion: 2.1 time: 0.293658 Jul 14 11:47:08.525904 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 191/421] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:08 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1678 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:08.606150 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6d2b43a2-0b3a-45a9-9ede-f97ef7ec5993 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:08.613761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6d2b43a2-0b3a-45a9-9ede-f97ef7ec5993 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1681 microversion: 2.1 time: 0.218949 Jul 14 11:47:08.614356 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 231/422] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:08 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:08.735325 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-5a5e76e4-c393-46e2-b9da-62cfc5a14747 req-d511efd3-eeae-498e-ab4c-fa9748997be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f44195-49ec-496b-937e-eb9722a215c0", "name": "network-vif-plugged", "status": "completed", "tag": "cf1c50ae-e6c8-42f3-9333-a8eaf141bcd0"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:08.736260 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-f0d82edf-3695-44b2-b955-bfa5ed1dff7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:08.736910 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-f0d82edf-3695-44b2-b955-bfa5ed1dff7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:08.751913 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-5a5e76e4-c393-46e2-b9da-62cfc5a14747 req-d511efd3-eeae-498e-ab4c-fa9748997be8 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:08.752855 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-5a5e76e4-c393-46e2-b9da-62cfc5a14747 req-d511efd3-eeae-498e-ab4c-fa9748997be8 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:08.755814 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f0d82edf-3695-44b2-b955-bfa5ed1dff7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:08.756518 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f0d82edf-3695-44b2-b955-bfa5ed1dff7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:08.757612 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f0d82edf-3695-44b2-b955-bfa5ed1dff7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:08.758970 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f0d82edf-3695-44b2-b955-bfa5ed1dff7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:08.796221 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-5a5e76e4-c393-46e2-b9da-62cfc5a14747 req-d511efd3-eeae-498e-ab4c-fa9748997be8 service nova] Creating event network-vif-plugged:cf1c50ae-e6c8-42f3-9333-a8eaf141bcd0 for instance 03f44195-49ec-496b-937e-eb9722a215c0 on hv-cinder-84980 Jul 14 11:47:08.804097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-5a5e76e4-c393-46e2-b9da-62cfc5a14747 req-d511efd3-eeae-498e-ab4c-fa9748997be8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079544 Jul 14 11:47:08.804700 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 232/423] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:47:08.991526 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f0d82edf-3695-44b2-b955-bfa5ed1dff7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:09.000053 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-f0d82edf-3695-44b2-b955-bfa5ed1dff7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1508 microversion: 2.1 time: 0.277382 Jul 14 11:47:09.000771 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 192/424] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:08 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1508 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:09.036544 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f64b379f-d9b6-4a9e-91df-3993e2024cbf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:09.036544 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f64b379f-d9b6-4a9e-91df-3993e2024cbf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:09.039958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f64b379f-d9b6-4a9e-91df-3993e2024cbf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:09.040502 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f64b379f-d9b6-4a9e-91df-3993e2024cbf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:09.041446 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f64b379f-d9b6-4a9e-91df-3993e2024cbf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:09.041944 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f64b379f-d9b6-4a9e-91df-3993e2024cbf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:09.129411 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-8eb1f0aa-76c0-43f2-969f-915d788a4cde tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:09.130224 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-8eb1f0aa-76c0-43f2-969f-915d788a4cde tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:09.145341 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8eb1f0aa-76c0-43f2-969f-915d788a4cde tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:09.145869 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8eb1f0aa-76c0-43f2-969f-915d788a4cde tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:09.146812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8eb1f0aa-76c0-43f2-969f-915d788a4cde tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:09.147314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8eb1f0aa-76c0-43f2-969f-915d788a4cde tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:09.197333 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f64b379f-d9b6-4a9e-91df-3993e2024cbf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:09.212368 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f64b379f-d9b6-4a9e-91df-3993e2024cbf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:09.214441 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f64b379f-d9b6-4a9e-91df-3993e2024cbf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:09.215667 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f64b379f-d9b6-4a9e-91df-3993e2024cbf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.188338 Jul 14 11:47:09.216228 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 233/425] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:47:09 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:47:09.232999 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-1d75796c-d16a-4b61-a4c9-aca9a25ff318 req-da0ac712-af63-42f0-88ea-78022d398cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b863b39-54e7-4601-bb9b-d41e745f2e25", "name": "network-vif-deleted", "tag": "1385e79d-6995-4f4e-8388-fd33d56039d8"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:09.241434 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-1d75796c-d16a-4b61-a4c9-aca9a25ff318 req-da0ac712-af63-42f0-88ea-78022d398cca service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:09.241878 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-1d75796c-d16a-4b61-a4c9-aca9a25ff318 req-da0ac712-af63-42f0-88ea-78022d398cca service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:09.262436 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-1d75796c-d16a-4b61-a4c9-aca9a25ff318 req-da0ac712-af63-42f0-88ea-78022d398cca service nova] Creating event network-vif-deleted:1385e79d-6995-4f4e-8388-fd33d56039d8 for instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 on hv-cinder-84980 Jul 14 11:47:09.268132 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-1d75796c-d16a-4b61-a4c9-aca9a25ff318 req-da0ac712-af63-42f0-88ea-78022d398cca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040246 Jul 14 11:47:09.269303 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 234/426] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:47:09.316806 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8eb1f0aa-76c0-43f2-969f-915d788a4cde tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:09.320933 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:09.325483 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-8eb1f0aa-76c0-43f2-969f-915d788a4cde tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1314 microversion: 2.1 time: 0.199818 Jul 14 11:47:09.329284 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 193/427] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:09 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:09.540274 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f5736e46-8657-4e01-a594-f1362aaefb86 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:09.541238 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f5736e46-8657-4e01-a594-f1362aaefb86 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:09.547690 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f5736e46-8657-4e01-a594-f1362aaefb86 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:09.548233 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f5736e46-8657-4e01-a594-f1362aaefb86 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:09.549106 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f5736e46-8657-4e01-a594-f1362aaefb86 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:09.549644 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f5736e46-8657-4e01-a594-f1362aaefb86 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:09.631941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-8b6a56da-8d8b-41ce-8fd7-056c88c729d9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:09.633433 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-8b6a56da-8d8b-41ce-8fd7-056c88c729d9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:09.640386 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8b6a56da-8d8b-41ce-8fd7-056c88c729d9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:09.640845 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8b6a56da-8d8b-41ce-8fd7-056c88c729d9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:09.641956 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8b6a56da-8d8b-41ce-8fd7-056c88c729d9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:09.642103 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8b6a56da-8d8b-41ce-8fd7-056c88c729d9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:09.718533 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f5736e46-8657-4e01-a594-f1362aaefb86 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:09.726951 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f5736e46-8657-4e01-a594-f1362aaefb86 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1678 microversion: 2.1 time: 0.191155 Jul 14 11:47:09.731520 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8b6a56da-8d8b-41ce-8fd7-056c88c729d9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:09.737196 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 235/428] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:09 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:09.744484 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-8b6a56da-8d8b-41ce-8fd7-056c88c729d9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1325 microversion: 2.1 time: 0.116138 Jul 14 11:47:09.749291 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 194/429] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:09 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1325 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:10.017602 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2bb0dc12-27e2-458c-a008-648367cd65e0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:10.018986 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2bb0dc12-27e2-458c-a008-648367cd65e0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:10.031969 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2bb0dc12-27e2-458c-a008-648367cd65e0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:10.032565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2bb0dc12-27e2-458c-a008-648367cd65e0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:10.033638 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2bb0dc12-27e2-458c-a008-648367cd65e0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:10.034160 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2bb0dc12-27e2-458c-a008-648367cd65e0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:10.183838 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2bb0dc12-27e2-458c-a008-648367cd65e0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:10.192359 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2bb0dc12-27e2-458c-a008-648367cd65e0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1508 microversion: 2.1 time: 0.179330 Jul 14 11:47:10.192942 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 236/430] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:10 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:10.234390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e62f1231-3f5f-4d88-8b39-2f940136de5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:10.235107 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e62f1231-3f5f-4d88-8b39-2f940136de5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:10.242339 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e62f1231-3f5f-4d88-8b39-2f940136de5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:10.242880 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e62f1231-3f5f-4d88-8b39-2f940136de5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:10.243749 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e62f1231-3f5f-4d88-8b39-2f940136de5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:10.244254 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e62f1231-3f5f-4d88-8b39-2f940136de5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:10.343006 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9097b47d-2693-4db3-8cd0-47698828678e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:10.343626 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9097b47d-2693-4db3-8cd0-47698828678e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:10.357024 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9097b47d-2693-4db3-8cd0-47698828678e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:10.357913 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9097b47d-2693-4db3-8cd0-47698828678e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:10.358969 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9097b47d-2693-4db3-8cd0-47698828678e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:10.359622 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9097b47d-2693-4db3-8cd0-47698828678e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:10.395600 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e62f1231-3f5f-4d88-8b39-2f940136de5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:10.405082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e62f1231-3f5f-4d88-8b39-2f940136de5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:10.411373 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e62f1231-3f5f-4d88-8b39-2f940136de5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:10.412691 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e62f1231-3f5f-4d88-8b39-2f940136de5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.182740 Jul 14 11:47:10.413385 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 195/431] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:47:10 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:47:10.525119 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9097b47d-2693-4db3-8cd0-47698828678e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:10.533826 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9097b47d-2693-4db3-8cd0-47698828678e tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1464 microversion: 2.1 time: 0.195007 Jul 14 11:47:10.534742 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 237/432] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:10 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1464 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:10.587183 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-17f034ef-e945-4d7a-9345-284962aae579 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:10.587708 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-17f034ef-e945-4d7a-9345-284962aae579 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:10.601402 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-17f034ef-e945-4d7a-9345-284962aae579 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:10.601880 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-17f034ef-e945-4d7a-9345-284962aae579 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:10.602684 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-17f034ef-e945-4d7a-9345-284962aae579 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:10.603132 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-17f034ef-e945-4d7a-9345-284962aae579 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:10.634964 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-17f034ef-e945-4d7a-9345-284962aae579 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Going to try to terminate instance {{(pid=124946) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:47:10.744372 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a00d1ba2-0b2f-43e7-950e-9d40e491d5b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:10.745273 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a00d1ba2-0b2f-43e7-950e-9d40e491d5b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:10.751460 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a00d1ba2-0b2f-43e7-950e-9d40e491d5b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:10.751898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a00d1ba2-0b2f-43e7-950e-9d40e491d5b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:10.752651 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a00d1ba2-0b2f-43e7-950e-9d40e491d5b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:10.753105 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a00d1ba2-0b2f-43e7-950e-9d40e491d5b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:10.886180 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a00d1ba2-0b2f-43e7-950e-9d40e491d5b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:10.893714 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a00d1ba2-0b2f-43e7-950e-9d40e491d5b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1678 microversion: 2.1 time: 0.153564 Jul 14 11:47:10.894488 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 238/433] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:10 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:10.899313 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-48a45d1b-10b6-4a34-aa40-b50c87095acc tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:10.899918 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-48a45d1b-10b6-4a34-aa40-b50c87095acc tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:10.907334 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-48a45d1b-10b6-4a34-aa40-b50c87095acc tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:10.908095 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-48a45d1b-10b6-4a34-aa40-b50c87095acc tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:10.909497 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-48a45d1b-10b6-4a34-aa40-b50c87095acc tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:10.910239 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-48a45d1b-10b6-4a34-aa40-b50c87095acc tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:10.950948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-17f034ef-e945-4d7a-9345-284962aae579 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 204 len: 0 microversion: 2.1 time: 0.368086 Jul 14 11:47:10.952050 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 196/434] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:47:10 2022] DELETE /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:10.960515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-06b4f290-1c1e-4144-bdac-6b9912118944 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:10.961378 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-06b4f290-1c1e-4144-bdac-6b9912118944 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:10.968651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-06b4f290-1c1e-4144-bdac-6b9912118944 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:10.969082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-06b4f290-1c1e-4144-bdac-6b9912118944 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:10.969967 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-06b4f290-1c1e-4144-bdac-6b9912118944 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:10.970485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-06b4f290-1c1e-4144-bdac-6b9912118944 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:10.978145 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-48a45d1b-10b6-4a34-aa40-b50c87095acc tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:10.986211 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-48a45d1b-10b6-4a34-aa40-b50c87095acc tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1325 microversion: 2.1 time: 0.090727 Jul 14 11:47:10.986811 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 239/435] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:10 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1325 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:11.105820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-06b4f290-1c1e-4144-bdac-6b9912118944 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:11.113777 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-06b4f290-1c1e-4144-bdac-6b9912118944 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1470 microversion: 2.1 time: 0.157645 Jul 14 11:47:11.114346 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 197/436] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:10 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:11.210138 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-66898d59-e0cf-4306-a835-09472c1381aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:11.210682 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-66898d59-e0cf-4306-a835-09472c1381aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:11.217443 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-66898d59-e0cf-4306-a835-09472c1381aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:11.217896 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-66898d59-e0cf-4306-a835-09472c1381aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:11.218749 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-66898d59-e0cf-4306-a835-09472c1381aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:11.219103 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-66898d59-e0cf-4306-a835-09472c1381aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:11.362481 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-66898d59-e0cf-4306-a835-09472c1381aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:11.372042 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-66898d59-e0cf-4306-a835-09472c1381aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1508 microversion: 2.1 time: 0.165736 Jul 14 11:47:11.373009 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 240/437] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:11 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:11.431075 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-01297ddf-959e-420a-bc95-6d77197afe80 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:11.431790 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-01297ddf-959e-420a-bc95-6d77197afe80 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:11.439662 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-01297ddf-959e-420a-bc95-6d77197afe80 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:11.440145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-01297ddf-959e-420a-bc95-6d77197afe80 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:11.441084 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-01297ddf-959e-420a-bc95-6d77197afe80 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:11.441548 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-01297ddf-959e-420a-bc95-6d77197afe80 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:11.574730 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-01297ddf-959e-420a-bc95-6d77197afe80 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:11.583274 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-01297ddf-959e-420a-bc95-6d77197afe80 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:11.584805 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-01297ddf-959e-420a-bc95-6d77197afe80 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:11.586028 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-01297ddf-959e-420a-bc95-6d77197afe80 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.159018 Jul 14 11:47:11.586589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 198/438] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:47:11 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:47:11.911301 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-daaac8c7-df94-4239-90b6-4b4205f0f308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:11.911830 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-daaac8c7-df94-4239-90b6-4b4205f0f308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:11.917883 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-daaac8c7-df94-4239-90b6-4b4205f0f308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:11.918344 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-daaac8c7-df94-4239-90b6-4b4205f0f308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:11.919091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-daaac8c7-df94-4239-90b6-4b4205f0f308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:11.919526 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-daaac8c7-df94-4239-90b6-4b4205f0f308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:11.937957 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:12.003276 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-eac3ceb6-ee1c-4dd4-9afd-4b2fa009ae09 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:12.003883 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-eac3ceb6-ee1c-4dd4-9afd-4b2fa009ae09 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:12.010049 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-eac3ceb6-ee1c-4dd4-9afd-4b2fa009ae09 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:12.010498 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-eac3ceb6-ee1c-4dd4-9afd-4b2fa009ae09 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:12.011256 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-eac3ceb6-ee1c-4dd4-9afd-4b2fa009ae09 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:12.011684 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-eac3ceb6-ee1c-4dd4-9afd-4b2fa009ae09 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:12.043690 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-eac3ceb6-ee1c-4dd4-9afd-4b2fa009ae09 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:12.044134 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-eac3ceb6-ee1c-4dd4-9afd-4b2fa009ae09 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:12.044690 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-eac3ceb6-ee1c-4dd4-9afd-4b2fa009ae09 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lazy-loading 'fault' on Instance uuid 3b863b39-54e7-4601-bb9b-d41e745f2e25 {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:47:12.054155 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-daaac8c7-df94-4239-90b6-4b4205f0f308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:12.061854 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-daaac8c7-df94-4239-90b6-4b4205f0f308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1678 microversion: 2.1 time: 0.154506 Jul 14 11:47:12.062610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 241/439] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:11 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:12.089725 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-eac3ceb6-ee1c-4dd4-9afd-4b2fa009ae09 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:12.097813 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-eac3ceb6-ee1c-4dd4-9afd-4b2fa009ae09 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1330 microversion: 2.1 time: 0.098331 Jul 14 11:47:12.098380 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 199/440] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:11 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:12.131211 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-22a47716-8875-47a6-850c-92850d702a41 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:12.131849 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-22a47716-8875-47a6-850c-92850d702a41 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:12.137766 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-22a47716-8875-47a6-850c-92850d702a41 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:12.138205 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-22a47716-8875-47a6-850c-92850d702a41 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:12.139501 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-22a47716-8875-47a6-850c-92850d702a41 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:12.139937 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-22a47716-8875-47a6-850c-92850d702a41 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:12.272817 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-22a47716-8875-47a6-850c-92850d702a41 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:12.281174 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-22a47716-8875-47a6-850c-92850d702a41 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1470 microversion: 2.1 time: 0.153771 Jul 14 11:47:12.281737 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 242/441] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:12 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:12.390001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5694fb6b-aec6-43bf-8a61-e99ebfe2b6ce tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:12.390615 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5694fb6b-aec6-43bf-8a61-e99ebfe2b6ce tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:12.397032 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5694fb6b-aec6-43bf-8a61-e99ebfe2b6ce tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:12.397510 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5694fb6b-aec6-43bf-8a61-e99ebfe2b6ce tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:12.398273 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5694fb6b-aec6-43bf-8a61-e99ebfe2b6ce tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:12.398704 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5694fb6b-aec6-43bf-8a61-e99ebfe2b6ce tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:12.529480 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5694fb6b-aec6-43bf-8a61-e99ebfe2b6ce tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:12.536949 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5694fb6b-aec6-43bf-8a61-e99ebfe2b6ce tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1508 microversion: 2.1 time: 0.151564 Jul 14 11:47:12.537553 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 200/442] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:12 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:12.604375 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1806275c-ffb2-4526-8e8b-3a0f48ab3b99 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:12.605042 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1806275c-ffb2-4526-8e8b-3a0f48ab3b99 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:12.611223 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1806275c-ffb2-4526-8e8b-3a0f48ab3b99 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:12.611648 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1806275c-ffb2-4526-8e8b-3a0f48ab3b99 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:12.612414 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1806275c-ffb2-4526-8e8b-3a0f48ab3b99 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:12.612852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1806275c-ffb2-4526-8e8b-3a0f48ab3b99 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:12.764736 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1806275c-ffb2-4526-8e8b-3a0f48ab3b99 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:12.773294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1806275c-ffb2-4526-8e8b-3a0f48ab3b99 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:12.775121 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1806275c-ffb2-4526-8e8b-3a0f48ab3b99 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:12.776277 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1806275c-ffb2-4526-8e8b-3a0f48ab3b99 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.175766 Jul 14 11:47:12.776823 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 243/443] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:47:12 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:47:13.079156 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-89489516-26c2-4106-8669-8def671104b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:13.079721 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-89489516-26c2-4106-8669-8def671104b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:13.085920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-89489516-26c2-4106-8669-8def671104b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:13.086475 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-89489516-26c2-4106-8669-8def671104b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:13.087243 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-89489516-26c2-4106-8669-8def671104b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:13.087686 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-89489516-26c2-4106-8669-8def671104b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:13.114646 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-155f882d-9c9b-46bb-a376-91e329217b0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:13.115418 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-155f882d-9c9b-46bb-a376-91e329217b0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:13.121765 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-155f882d-9c9b-46bb-a376-91e329217b0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:13.122213 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-155f882d-9c9b-46bb-a376-91e329217b0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:13.122985 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-155f882d-9c9b-46bb-a376-91e329217b0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:13.123414 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-155f882d-9c9b-46bb-a376-91e329217b0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:13.155410 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-155f882d-9c9b-46bb-a376-91e329217b0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:13.155853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-155f882d-9c9b-46bb-a376-91e329217b0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:13.156312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-155f882d-9c9b-46bb-a376-91e329217b0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lazy-loading 'fault' on Instance uuid 3b863b39-54e7-4601-bb9b-d41e745f2e25 {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:47:13.204590 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-155f882d-9c9b-46bb-a376-91e329217b0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:13.212663 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-155f882d-9c9b-46bb-a376-91e329217b0c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1330 microversion: 2.1 time: 0.101547 Jul 14 11:47:13.217227 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 244/444] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:13 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:13.220148 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-89489516-26c2-4106-8669-8def671104b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:13.227999 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-89489516-26c2-4106-8669-8def671104b2 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1678 microversion: 2.1 time: 0.152843 Jul 14 11:47:13.228556 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 201/445] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:13 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:13.298670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1490e72a-5b79-48bb-842f-29fe26d20230 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:13.299282 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1490e72a-5b79-48bb-842f-29fe26d20230 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:13.305294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1490e72a-5b79-48bb-842f-29fe26d20230 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:13.305734 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1490e72a-5b79-48bb-842f-29fe26d20230 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:13.306482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1490e72a-5b79-48bb-842f-29fe26d20230 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:13.306910 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1490e72a-5b79-48bb-842f-29fe26d20230 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:13.440047 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1490e72a-5b79-48bb-842f-29fe26d20230 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:13.447867 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1490e72a-5b79-48bb-842f-29fe26d20230 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1470 microversion: 2.1 time: 0.153709 Jul 14 11:47:13.448468 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 245/446] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:13 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:13.553306 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6262ed58-55b6-4806-b977-07145338d202 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:13.553928 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6262ed58-55b6-4806-b977-07145338d202 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:13.560540 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6262ed58-55b6-4806-b977-07145338d202 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:13.560991 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6262ed58-55b6-4806-b977-07145338d202 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:13.561813 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6262ed58-55b6-4806-b977-07145338d202 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:13.562252 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6262ed58-55b6-4806-b977-07145338d202 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:13.691348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6262ed58-55b6-4806-b977-07145338d202 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:13.703611 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6262ed58-55b6-4806-b977-07145338d202 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1514 microversion: 2.1 time: 0.153818 Jul 14 11:47:13.704622 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 202/447] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:13 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:13.794453 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-758b6ef0-53b2-497f-a6dc-512c7acc64d3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:13.795252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-758b6ef0-53b2-497f-a6dc-512c7acc64d3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:13.802113 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-758b6ef0-53b2-497f-a6dc-512c7acc64d3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:13.802952 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-758b6ef0-53b2-497f-a6dc-512c7acc64d3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:13.803334 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-758b6ef0-53b2-497f-a6dc-512c7acc64d3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:13.803769 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-758b6ef0-53b2-497f-a6dc-512c7acc64d3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:13.975375 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-758b6ef0-53b2-497f-a6dc-512c7acc64d3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:13.983867 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-758b6ef0-53b2-497f-a6dc-512c7acc64d3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:13.985465 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-758b6ef0-53b2-497f-a6dc-512c7acc64d3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:13.986681 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-758b6ef0-53b2-497f-a6dc-512c7acc64d3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.196058 Jul 14 11:47:13.987232 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 246/448] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:47:13 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:47:14.229880 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d9e3afcf-d580-4c31-a8dc-b957a3738c9f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:14.230510 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d9e3afcf-d580-4c31-a8dc-b957a3738c9f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:14.237802 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d9e3afcf-d580-4c31-a8dc-b957a3738c9f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:14.238142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d9e3afcf-d580-4c31-a8dc-b957a3738c9f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:14.240308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d9e3afcf-d580-4c31-a8dc-b957a3738c9f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:14.240308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d9e3afcf-d580-4c31-a8dc-b957a3738c9f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:14.247485 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-21b423eb-76c4-4eba-a446-749ccc7d5d47 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:14.248728 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-21b423eb-76c4-4eba-a446-749ccc7d5d47 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:14.255378 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-21b423eb-76c4-4eba-a446-749ccc7d5d47 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:14.255821 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-21b423eb-76c4-4eba-a446-749ccc7d5d47 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:14.256592 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-21b423eb-76c4-4eba-a446-749ccc7d5d47 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:14.257791 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-21b423eb-76c4-4eba-a446-749ccc7d5d47 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:14.275653 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d9e3afcf-d580-4c31-a8dc-b957a3738c9f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:14.276096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d9e3afcf-d580-4c31-a8dc-b957a3738c9f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:14.276549 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-d9e3afcf-d580-4c31-a8dc-b957a3738c9f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lazy-loading 'fault' on Instance uuid 3b863b39-54e7-4601-bb9b-d41e745f2e25 {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:47:14.426318 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-21b423eb-76c4-4eba-a446-749ccc7d5d47 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:14.434423 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-21b423eb-76c4-4eba-a446-749ccc7d5d47 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1678 microversion: 2.1 time: 0.192438 Jul 14 11:47:14.444490 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 247/449] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:14 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:14.470206 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-214712fa-8c8d-41f0-91a4-480e055789c8 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:14.470206 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-214712fa-8c8d-41f0-91a4-480e055789c8 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:14.474543 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-214712fa-8c8d-41f0-91a4-480e055789c8 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:14.475086 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-214712fa-8c8d-41f0-91a4-480e055789c8 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:14.476090 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-214712fa-8c8d-41f0-91a4-480e055789c8 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:14.476594 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-214712fa-8c8d-41f0-91a4-480e055789c8 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:14.519360 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d9e3afcf-d580-4c31-a8dc-b957a3738c9f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:14.526678 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d9e3afcf-d580-4c31-a8dc-b957a3738c9f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 200 len: 1330 microversion: 2.1 time: 0.300638 Jul 14 11:47:14.527496 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 203/450] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:14 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 1330 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:14.622718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-214712fa-8c8d-41f0-91a4-480e055789c8 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:14.630593 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-214712fa-8c8d-41f0-91a4-480e055789c8 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1470 microversion: 2.1 time: 0.168447 Jul 14 11:47:14.635499 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 248/451] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:14 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:14.842306 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-d5af95cb-afb8-48fb-b153-63fae8419ad1 req-5b03c293-cc66-4454-9291-92666dc559bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70b1731-0a31-4df3-99fe-42587445a297", "name": "network-vif-deleted", "tag": "ba72d0b2-3ada-4475-825a-02b31c695891"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:14.852615 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-d5af95cb-afb8-48fb-b153-63fae8419ad1 req-5b03c293-cc66-4454-9291-92666dc559bb service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:14.854524 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-d5af95cb-afb8-48fb-b153-63fae8419ad1 req-5b03c293-cc66-4454-9291-92666dc559bb service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:14.866940 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-d5af95cb-afb8-48fb-b153-63fae8419ad1 req-5b03c293-cc66-4454-9291-92666dc559bb service nova] Creating event network-vif-deleted:ba72d0b2-3ada-4475-825a-02b31c695891 for instance a70b1731-0a31-4df3-99fe-42587445a297 on hv-cinder-84980 Jul 14 11:47:14.871999 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-d5af95cb-afb8-48fb-b153-63fae8419ad1 req-5b03c293-cc66-4454-9291-92666dc559bb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035119 Jul 14 11:47:14.872833 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 204/452] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:47:15.003888 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-771e3c8d-081d-4abb-af3e-cb1df78be1b4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:15.004495 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-771e3c8d-081d-4abb-af3e-cb1df78be1b4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:15.010574 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-771e3c8d-081d-4abb-af3e-cb1df78be1b4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:15.011018 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-771e3c8d-081d-4abb-af3e-cb1df78be1b4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:15.011783 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-771e3c8d-081d-4abb-af3e-cb1df78be1b4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:15.012218 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-771e3c8d-081d-4abb-af3e-cb1df78be1b4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:15.146672 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-771e3c8d-081d-4abb-af3e-cb1df78be1b4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:15.156335 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-771e3c8d-081d-4abb-af3e-cb1df78be1b4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:15.157917 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-771e3c8d-081d-4abb-af3e-cb1df78be1b4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:15.159061 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-771e3c8d-081d-4abb-af3e-cb1df78be1b4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.159120 Jul 14 11:47:15.159736 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 249/453] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:47:14 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:47:15.439489 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-23d1a0e1-4f8b-4a13-9e31-3a63c9e2e4d7 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Action: 'create', calling method: .version_select at 0x7f1ae435d670>, body: {"keypair": {"name": "tempest-keypair-2146376758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMMhgbZN7lB/DIhwvCV1HugMHd+jZ/6HHfo7b1DlgdJoIOp+BJkZqJLLzSGklPxJcPuva7lJt61eiq/IICn47nvxJQSuZeMKUEXoLqaafR1fkCTWaZ7kWdeYh67gPRhdw=="}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:15.451693 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-eaba28f9-41c6-4d50-a4e5-14194539afd5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:15.452311 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-eaba28f9-41c6-4d50-a4e5-14194539afd5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:15.453872 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-23d1a0e1-4f8b-4a13-9e31-3a63c9e2e4d7 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Getting quotas for project 951609a482e34e93908057a68c5dc706. Resources: {'key_pairs'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:47:15.458212 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-23d1a0e1-4f8b-4a13-9e31-3a63c9e2e4d7 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Getting quotas for user 7bf3f705e04640a2a5d9bedb71c6ccb5 and project 951609a482e34e93908057a68c5dc706. Resources: {'key_pairs'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:47:15.458372 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-eaba28f9-41c6-4d50-a4e5-14194539afd5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:15.458761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-eaba28f9-41c6-4d50-a4e5-14194539afd5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:15.459538 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-eaba28f9-41c6-4d50-a4e5-14194539afd5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:15.459977 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-eaba28f9-41c6-4d50-a4e5-14194539afd5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:15.546732 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-23d1a0e1-4f8b-4a13-9e31-3a63c9e2e4d7 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111425 Jul 14 11:47:15.547475 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 205/454] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 11:47:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:47:15.552390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c7402d3d-bf1d-4089-a03f-b66fccdb8e15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:15.556467 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c7402d3d-bf1d-4089-a03f-b66fccdb8e15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:15.559728 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c7402d3d-bf1d-4089-a03f-b66fccdb8e15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:15.560354 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c7402d3d-bf1d-4089-a03f-b66fccdb8e15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:15.561248 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c7402d3d-bf1d-4089-a03f-b66fccdb8e15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:15.561777 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c7402d3d-bf1d-4089-a03f-b66fccdb8e15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:15.578390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-c7402d3d-bf1d-4089-a03f-b66fccdb8e15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] HTTP exception thrown: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c7402d3d-bf1d-4089-a03f-b66fccdb8e15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Request method failure captured: Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 HTTP/1.1 Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGNrCXQELDmNK7QTgAsdlJtPBM_GXw3pFQ92I5FXg_Nl7xnN8erDQ0jD6cBgqZwNWgSGDIvH_OU-IJPWW0i2GmYKcnE8wD4a47a9DJeOO5JgDloTkiJ3A6EcxYhG-symYmW7J8b_ws3S47CzQaA9KAgAK_QrTjwz8qGsPABa7uBQLs Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:47:15.580166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:47:15.581515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f274d555f5c746cc885394c699b3d767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f274d555f5c746cc885394c699b3d767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:47:15.581515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:47:15.581515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:47:15.581515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:47:15.581515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:47:15.581515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:47:15.581515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:47:15.581515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 8773c88f88614a9d903f667305a217e0 Jul 14 11:47:15.581515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:47:15.581515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:47:15.581515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. Jul 14 11:47:15.581515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '3b863b39-54e7-4601-bb9b-d41e745f2e25'} Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:47:15.582227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. Jul 14 11:47:15.583390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:47:15.584441 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c7402d3d-bf1d-4089-a03f-b66fccdb8e15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Returning 404 to user: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:47:15.584441 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c7402d3d-bf1d-4089-a03f-b66fccdb8e15 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 404 len: 111 microversion: 2.1 time: 0.033314 Jul 14 11:47:15.584441 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 206/455] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:15 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:47:15.591213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c9040988-c927-42b0-b7d7-f58b0c29df86 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '.version_select at 0x7f1adf725430>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:15.595830 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-eaba28f9-41c6-4d50-a4e5-14194539afd5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:15.603906 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-eaba28f9-41c6-4d50-a4e5-14194539afd5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1678 microversion: 2.1 time: 0.156031 Jul 14 11:47:15.604634 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 250/456] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:15 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:15.605849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:15.649484 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-51419276-618b-4b66-8529-cfbe379e97c2 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:15.650160 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-51419276-618b-4b66-8529-cfbe379e97c2 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:15.657030 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-51419276-618b-4b66-8529-cfbe379e97c2 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:15.657624 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-51419276-618b-4b66-8529-cfbe379e97c2 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:15.658269 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-51419276-618b-4b66-8529-cfbe379e97c2 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:15.658694 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-51419276-618b-4b66-8529-cfbe379e97c2 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:15.681950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c9040988-c927-42b0-b7d7-f58b0c29df86 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-135430694" status: 202 len: 0 microversion: 2.1 time: 0.093110 Jul 14 11:47:15.688230 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 207/457] 10.222.0.40 () {58 vars in 1217 bytes} [Thu Jul 14 11:47:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-135430694 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:47:15.697960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-51419276-618b-4b66-8529-cfbe379e97c2 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:15.698425 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-51419276-618b-4b66-8529-cfbe379e97c2 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:15.699533 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-51419276-618b-4b66-8529-cfbe379e97c2 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lazy-loading 'fault' on Instance uuid a70b1731-0a31-4df3-99fe-42587445a297 {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:47:15.763142 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-51419276-618b-4b66-8529-cfbe379e97c2 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983f6117721d436786fe8827a13a3f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec44d80054e49e9ba17a711740b1a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:15.772876 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-51419276-618b-4b66-8529-cfbe379e97c2 tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 200 len: 1304 microversion: 2.1 time: 0.128581 Jul 14 11:47:15.783846 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 251/458] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:15 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:16.180880 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-85a8c4a2-e45a-43e6-accc-fd893579dfc6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:16.181528 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-85a8c4a2-e45a-43e6-accc-fd893579dfc6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:16.192277 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-85a8c4a2-e45a-43e6-accc-fd893579dfc6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:16.192697 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-85a8c4a2-e45a-43e6-accc-fd893579dfc6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:16.193511 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-85a8c4a2-e45a-43e6-accc-fd893579dfc6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:16.193979 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-85a8c4a2-e45a-43e6-accc-fd893579dfc6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:16.430073 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-85a8c4a2-e45a-43e6-accc-fd893579dfc6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:16.443924 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-85a8c4a2-e45a-43e6-accc-fd893579dfc6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:16.450556 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-85a8c4a2-e45a-43e6-accc-fd893579dfc6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:16.450556 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-85a8c4a2-e45a-43e6-accc-fd893579dfc6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1809 microversion: 2.20 time: 0.274029 Jul 14 11:47:16.450556 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 208/459] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:47:16 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1809 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:47:16.622164 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-75bda51f-db3c-4191-9317-b676cf768b3c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:16.623485 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-75bda51f-db3c-4191-9317-b676cf768b3c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:16.631112 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-75bda51f-db3c-4191-9317-b676cf768b3c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:16.631554 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-75bda51f-db3c-4191-9317-b676cf768b3c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:16.632724 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-75bda51f-db3c-4191-9317-b676cf768b3c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:16.633375 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-75bda51f-db3c-4191-9317-b676cf768b3c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:16.699846 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-68abe83e-9011-48d4-bd04-9627223634f7 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:16.700334 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-68abe83e-9011-48d4-bd04-9627223634f7 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:16.706849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-68abe83e-9011-48d4-bd04-9627223634f7 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:16.707309 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-68abe83e-9011-48d4-bd04-9627223634f7 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:16.708095 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-68abe83e-9011-48d4-bd04-9627223634f7 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:16.708573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-68abe83e-9011-48d4-bd04-9627223634f7 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:16.782465 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-75bda51f-db3c-4191-9317-b676cf768b3c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:16.790986 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-75bda51f-db3c-4191-9317-b676cf768b3c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1678 microversion: 2.1 time: 0.172884 Jul 14 11:47:16.792188 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 252/460] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:16 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:16.799772 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2c77d5ce-4a48-4c03-a3e8-5a645199c81f tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:16.799772 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2c77d5ce-4a48-4c03-a3e8-5a645199c81f tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] [instance: a70b1731-0a31-4df3-99fe-42587445a297] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:16.814335 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2c77d5ce-4a48-4c03-a3e8-5a645199c81f tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:16.814788 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2c77d5ce-4a48-4c03-a3e8-5a645199c81f tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:16.815578 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2c77d5ce-4a48-4c03-a3e8-5a645199c81f tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:16.816015 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2c77d5ce-4a48-4c03-a3e8-5a645199c81f tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:16.831973 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-2c77d5ce-4a48-4c03-a3e8-5a645199c81f tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] HTTP exception thrown: Instance a70b1731-0a31-4df3-99fe-42587445a297 could not be found. Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2c77d5ce-4a48-4c03-a3e8-5a645199c81f tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Request method failure captured: Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 HTTP/1.1 Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AIWaXqqdrpLXsxq2nULsoBEXs6TExkunRKout9bLgW4LUzo1b0afpOe1kX-2qcEasfJOAzmRNjA80o8krb3WnR4zMCuer0OrRiplYSQhaY-O98VfHs1PNUdEP8dzB0kTXNTVDdwt6_ZezTRSW5InY6caZWPpsykUn5OeQAhUUApqG8 Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 1ec44d80054e49e9ba17a711740b1a3d Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-VolumesNegativeTest-119519696 Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:47:16.833755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:47:16.835565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ec44d80054e49e9ba17a711740b1a3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ec44d80054e49e9ba17a711740b1a3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ec44d80054e49e9ba17a711740b1a3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ec44d80054e49e9ba17a711740b1a3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:47:16.835565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-VolumesNegativeTest-119519696 Jul 14 11:47:16.835565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 1ec44d80054e49e9ba17a711740b1a3d Jul 14 11:47:16.835565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-VolumesNegativeTest-119519696 Jul 14 11:47:16.835565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-VolumesNegativeTest-119519696-project Jul 14 11:47:16.835565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:47:16.835565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:47:16.835565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 983f6117721d436786fe8827a13a3f01 Jul 14 11:47:16.835565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-VolumesNegativeTest-119519696-project Jul 14 11:47:16.835565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:47:16.835565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance a70b1731-0a31-4df3-99fe-42587445a297 could not be found. Jul 14 11:47:16.835565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': 'a70b1731-0a31-4df3-99fe-42587445a297'} Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70b1731-0a31-4df3-99fe-42587445a297 could not be found. Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:47:16.836489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70b1731-0a31-4df3-99fe-42587445a297 could not be found. Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70b1731-0a31-4df3-99fe-42587445a297 could not be found. Jul 14 11:47:16.838063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:47:16.839158 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2c77d5ce-4a48-4c03-a3e8-5a645199c81f tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] Returning 404 to user: Instance a70b1731-0a31-4df3-99fe-42587445a297 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:47:16.839158 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2c77d5ce-4a48-4c03-a3e8-5a645199c81f tempest-VolumesNegativeTest-119519696 tempest-VolumesNegativeTest-119519696-project] 10.222.0.40 "GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297" status: 404 len: 111 microversion: 2.1 time: 0.043597 Jul 14 11:47:16.839158 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 253/461] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:16 2022] GET /compute/v2.1/servers/a70b1731-0a31-4df3-99fe-42587445a297 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:47:16.860666 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-68abe83e-9011-48d4-bd04-9627223634f7 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lazy-loading 'services' on Instance uuid edc1d8c0-48e2-49bd-8807-bb041db6a9df {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:47:17.177196 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-68abe83e-9011-48d4-bd04-9627223634f7 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "DELETE /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df/os-volume_attachments/82c9edf1-12cf-4a6d-9e2b-976024f6c6e9" status: 202 len: 0 microversion: 2.1 time: 0.481091 Jul 14 11:47:17.180993 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 209/462] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 11:47:16 2022] DELETE /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df/os-volume_attachments/82c9edf1-12cf-4a6d-9e2b-976024f6c6e9 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:47:17.191008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-217a1125-a2c1-4374-b799-d184d3061b5a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:17.192638 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-217a1125-a2c1-4374-b799-d184d3061b5a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:17.200230 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-217a1125-a2c1-4374-b799-d184d3061b5a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:17.200758 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-217a1125-a2c1-4374-b799-d184d3061b5a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:17.202372 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-217a1125-a2c1-4374-b799-d184d3061b5a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:17.202874 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-217a1125-a2c1-4374-b799-d184d3061b5a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:17.236152 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-217a1125-a2c1-4374-b799-d184d3061b5a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051578 Jul 14 11:47:17.236879 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 254/463] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:47:17 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:47:17.466147 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-7f98912e-837a-468e-ba30-e8318a7caae4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:17.467903 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-7f98912e-837a-468e-ba30-e8318a7caae4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:17.477056 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7f98912e-837a-468e-ba30-e8318a7caae4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:17.477547 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7f98912e-837a-468e-ba30-e8318a7caae4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:17.478317 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7f98912e-837a-468e-ba30-e8318a7caae4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:17.478761 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7f98912e-837a-468e-ba30-e8318a7caae4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:17.668710 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-7f98912e-837a-468e-ba30-e8318a7caae4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:17.673590 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:17.679023 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-7f98912e-837a-468e-ba30-e8318a7caae4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:17.680563 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-7f98912e-837a-468e-ba30-e8318a7caae4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:17.681780 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-7f98912e-837a-468e-ba30-e8318a7caae4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1796 microversion: 2.20 time: 0.219912 Jul 14 11:47:17.682327 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 210/464] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:47:17 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1796 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:47:17.813412 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7e56511f-b3fb-4972-ad08-c28332775353 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:17.814024 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7e56511f-b3fb-4972-ad08-c28332775353 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:17.820317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7e56511f-b3fb-4972-ad08-c28332775353 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:17.820764 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7e56511f-b3fb-4972-ad08-c28332775353 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:17.821629 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7e56511f-b3fb-4972-ad08-c28332775353 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:17.822066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7e56511f-b3fb-4972-ad08-c28332775353 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:18.007948 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7e56511f-b3fb-4972-ad08-c28332775353 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:18.016150 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7e56511f-b3fb-4972-ad08-c28332775353 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1678 microversion: 2.1 time: 0.206783 Jul 14 11:47:18.016728 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 255/465] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:17 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:18.145406 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-910929932", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ebc2b171-9c41-4e23-a0fc-6ea3655664fa"}], "security_groups": [{"name": "tempest-securitygroup--716418125"}], "key_name": "tempest-keypair-2146376758", "user_data": "}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:18.248410 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-cf205908-9efb-457b-9bb2-5102d26193cf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:18.249462 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-cf205908-9efb-457b-9bb2-5102d26193cf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:18.254745 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.network.neutron [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] validate_networks() for [('ebc2b171-9c41-4e23-a0fc-6ea3655664fa', None, None, None, None, None)] {{(pid=124946) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:47:18.255602 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cf205908-9efb-457b-9bb2-5102d26193cf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:18.256043 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cf205908-9efb-457b-9bb2-5102d26193cf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:18.256808 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cf205908-9efb-457b-9bb2-5102d26193cf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:18.257297 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cf205908-9efb-457b-9bb2-5102d26193cf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:18.286797 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-cf205908-9efb-457b-9bb2-5102d26193cf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042794 Jul 14 11:47:18.291072 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 256/466] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:47:18 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:47:18.660081 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Flavor limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:47:18.660546 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Image limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:47:18.660970 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Flavor pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:47:18.661453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Image pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:47:18.661863 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:47:18.671229 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:18.671674 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:18.672467 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:18.672902 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:18.690341 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Getting quotas for project 951609a482e34e93908057a68c5dc706. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:47:18.701084 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Getting quotas for user 7bf3f705e04640a2a5d9bedb71c6ccb5 and project 951609a482e34e93908057a68c5dc706. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:47:18.713548 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Going to run 1 instances... {{(pid=124946) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:47:18.715566 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124946) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:47:18.827926 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3981503a-7550-446f-9239-50912437efa6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.686724 Jul 14 11:47:18.828601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 211/467] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:47:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:47:18.838802 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3bdf5f22-8936-4138-b064-02968c32fb8e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:18.839658 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3bdf5f22-8936-4138-b064-02968c32fb8e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:18.903975 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3bdf5f22-8936-4138-b064-02968c32fb8e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:18.909400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3bdf5f22-8936-4138-b064-02968c32fb8e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1245 microversion: 2.1 time: 0.074548 Jul 14 11:47:18.910308 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 257/468] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:18 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:19.034240 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-aebf8e4a-0426-4737-bbfb-b3733e044f9a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:19.034885 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-aebf8e4a-0426-4737-bbfb-b3733e044f9a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:19.041988 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-aebf8e4a-0426-4737-bbfb-b3733e044f9a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:19.042437 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-aebf8e4a-0426-4737-bbfb-b3733e044f9a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:19.043213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-aebf8e4a-0426-4737-bbfb-b3733e044f9a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:19.043834 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-aebf8e4a-0426-4737-bbfb-b3733e044f9a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:19.189003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-aebf8e4a-0426-4737-bbfb-b3733e044f9a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:19.197612 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-aebf8e4a-0426-4737-bbfb-b3733e044f9a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1655 microversion: 2.1 time: 0.168223 Jul 14 11:47:19.198197 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 212/469] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:19 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1655 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:19.215340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-35ba1e9a-a4f8-42ac-ac20-c0d8abf61f23 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:19.221508 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-35ba1e9a-a4f8-42ac-ac20-c0d8abf61f23 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:19.222014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-35ba1e9a-a4f8-42ac-ac20-c0d8abf61f23 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:19.243444 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-35ba1e9a-a4f8-42ac-ac20-c0d8abf61f23 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Going to try to start instance {{(pid=124947) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 11:47:19.260341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=100 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:19.299173 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d129092a-6e0f-44a5-815c-c36edfd5774a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:19.300194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d129092a-6e0f-44a5-815c-c36edfd5774a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:19.307124 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d129092a-6e0f-44a5-815c-c36edfd5774a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:19.307577 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d129092a-6e0f-44a5-815c-c36edfd5774a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:19.308347 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d129092a-6e0f-44a5-815c-c36edfd5774a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:19.308830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d129092a-6e0f-44a5-815c-c36edfd5774a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:19.339267 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d129092a-6e0f-44a5-815c-c36edfd5774a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044605 Jul 14 11:47:19.340303 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 213/470] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:47:19 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 11:47:19.407176 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3c35cf4c-d56a-4aad-8b56-d4b7e3dd7189 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:19.407676 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3c35cf4c-d56a-4aad-8b56-d4b7e3dd7189 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:19.413989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3c35cf4c-d56a-4aad-8b56-d4b7e3dd7189 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:19.414439 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3c35cf4c-d56a-4aad-8b56-d4b7e3dd7189 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:19.415204 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3c35cf4c-d56a-4aad-8b56-d4b7e3dd7189 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:19.415639 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3c35cf4c-d56a-4aad-8b56-d4b7e3dd7189 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:19.441762 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3c35cf4c-d56a-4aad-8b56-d4b7e3dd7189 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Going to try to terminate instance {{(pid=124946) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:47:19.531239 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-35ba1e9a-a4f8-42ac-ac20-c0d8abf61f23 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "POST /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/action" status: 202 len: 0 microversion: 2.1 time: 0.319731 Jul 14 11:47:19.531844 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 258/471] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 11:47:19 2022] POST /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:47:19.540607 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-de92c1b0-1dbc-4974-b003-f50330e2fbed tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:19.541377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-de92c1b0-1dbc-4974-b003-f50330e2fbed tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:19.548199 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-de92c1b0-1dbc-4974-b003-f50330e2fbed tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:19.548648 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-de92c1b0-1dbc-4974-b003-f50330e2fbed tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:19.549481 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-de92c1b0-1dbc-4974-b003-f50330e2fbed tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:19.549921 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-de92c1b0-1dbc-4974-b003-f50330e2fbed tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:19.689882 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-de92c1b0-1dbc-4974-b003-f50330e2fbed tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:19.702107 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-de92c1b0-1dbc-4974-b003-f50330e2fbed tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1664 microversion: 2.1 time: 0.163433 Jul 14 11:47:19.702107 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 259/472] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:19 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:19.831674 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3c35cf4c-d56a-4aad-8b56-d4b7e3dd7189 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "DELETE /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 204 len: 0 microversion: 2.1 time: 0.428049 Jul 14 11:47:19.832774 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 214/473] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:47:19 2022] DELETE /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:47:19.840968 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-59b8fbca-602a-4559-bd25-01266034fdee tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:19.842139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-59b8fbca-602a-4559-bd25-01266034fdee tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:19.848236 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-59b8fbca-602a-4559-bd25-01266034fdee tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:19.848688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-59b8fbca-602a-4559-bd25-01266034fdee tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:19.849507 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-59b8fbca-602a-4559-bd25-01266034fdee tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:19.849946 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-59b8fbca-602a-4559-bd25-01266034fdee tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:19.927220 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-96767824-d247-444c-90e0-167d6ebcdd88 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:19.927926 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-96767824-d247-444c-90e0-167d6ebcdd88 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:19.936476 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96767824-d247-444c-90e0-167d6ebcdd88 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:19.936911 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96767824-d247-444c-90e0-167d6ebcdd88 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:19.937736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96767824-d247-444c-90e0-167d6ebcdd88 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:19.938176 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96767824-d247-444c-90e0-167d6ebcdd88 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:20.010960 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-96767824-d247-444c-90e0-167d6ebcdd88 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:20.016137 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-59b8fbca-602a-4559-bd25-01266034fdee tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:20.017972 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-96767824-d247-444c-90e0-167d6ebcdd88 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1249 microversion: 2.1 time: 0.094698 Jul 14 11:47:20.018912 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 215/474] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:19 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1249 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:20.026783 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-59b8fbca-602a-4559-bd25-01266034fdee tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1682 microversion: 2.1 time: 0.189547 Jul 14 11:47:20.027900 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 260/475] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:19 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1682 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:20.716656 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-04a99339-15f7-4555-b9f6-75828a1ffb6d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:20.717604 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-04a99339-15f7-4555-b9f6-75828a1ffb6d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:20.724481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-04a99339-15f7-4555-b9f6-75828a1ffb6d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:20.724927 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-04a99339-15f7-4555-b9f6-75828a1ffb6d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:20.725808 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-04a99339-15f7-4555-b9f6-75828a1ffb6d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:20.726133 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-04a99339-15f7-4555-b9f6-75828a1ffb6d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:20.870330 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-04a99339-15f7-4555-b9f6-75828a1ffb6d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:20.878522 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-04a99339-15f7-4555-b9f6-75828a1ffb6d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1664 microversion: 2.1 time: 0.165694 Jul 14 11:47:20.879092 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 216/476] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:20 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:21.035467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b67a40f6-9f00-48d4-ab1d-023bbee1917d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:21.036078 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b67a40f6-9f00-48d4-ab1d-023bbee1917d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:21.042407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b67a40f6-9f00-48d4-ab1d-023bbee1917d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:21.042853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b67a40f6-9f00-48d4-ab1d-023bbee1917d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:21.043628 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b67a40f6-9f00-48d4-ab1d-023bbee1917d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:21.043860 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-09cc38e3-a7f4-4aa9-8220-6a7fa20eeb65 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:21.044064 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b67a40f6-9f00-48d4-ab1d-023bbee1917d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:21.044476 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-09cc38e3-a7f4-4aa9-8220-6a7fa20eeb65 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:21.051439 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-09cc38e3-a7f4-4aa9-8220-6a7fa20eeb65 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:21.051892 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-09cc38e3-a7f4-4aa9-8220-6a7fa20eeb65 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:21.052681 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-09cc38e3-a7f4-4aa9-8220-6a7fa20eeb65 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:21.053103 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-09cc38e3-a7f4-4aa9-8220-6a7fa20eeb65 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:21.111574 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b67a40f6-9f00-48d4-ab1d-023bbee1917d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:21.119014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b67a40f6-9f00-48d4-ab1d-023bbee1917d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1249 microversion: 2.1 time: 0.087355 Jul 14 11:47:21.119591 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 261/477] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:21 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:21.188180 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-09cc38e3-a7f4-4aa9-8220-6a7fa20eeb65 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:21.195726 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-09cc38e3-a7f4-4aa9-8220-6a7fa20eeb65 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1682 microversion: 2.1 time: 0.155774 Jul 14 11:47:21.196284 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 217/478] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:21 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:21.896025 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b1037970-21a7-4ec9-9d5a-13159bc100d5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:21.896777 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b1037970-21a7-4ec9-9d5a-13159bc100d5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:21.903724 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b1037970-21a7-4ec9-9d5a-13159bc100d5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:21.904285 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b1037970-21a7-4ec9-9d5a-13159bc100d5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:21.905808 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b1037970-21a7-4ec9-9d5a-13159bc100d5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:21.906250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b1037970-21a7-4ec9-9d5a-13159bc100d5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:22.136477 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-bf380c3a-f9f4-4b02-a5a6-f16077cacb69 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:22.137229 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-bf380c3a-f9f4-4b02-a5a6-f16077cacb69 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:22.144462 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bf380c3a-f9f4-4b02-a5a6-f16077cacb69 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:22.144908 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bf380c3a-f9f4-4b02-a5a6-f16077cacb69 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:22.145931 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bf380c3a-f9f4-4b02-a5a6-f16077cacb69 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:22.146372 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bf380c3a-f9f4-4b02-a5a6-f16077cacb69 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:22.214482 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-bf380c3a-f9f4-4b02-a5a6-f16077cacb69 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:22.222372 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b1037970-21a7-4ec9-9d5a-13159bc100d5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:22.222813 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-bf380c3a-f9f4-4b02-a5a6-f16077cacb69 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1297 microversion: 2.1 time: 0.089682 Jul 14 11:47:22.223322 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 218/479] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:22 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:22.227997 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c2d32bbd-ed91-4c6b-ade6-0f53b3b46638 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:22.228596 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c2d32bbd-ed91-4c6b-ade6-0f53b3b46638 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:22.231053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b1037970-21a7-4ec9-9d5a-13159bc100d5 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1664 microversion: 2.1 time: 0.338987 Jul 14 11:47:22.231782 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 262/480] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:21 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1664 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:22.235417 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c2d32bbd-ed91-4c6b-ade6-0f53b3b46638 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:22.235918 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c2d32bbd-ed91-4c6b-ade6-0f53b3b46638 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:22.236684 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c2d32bbd-ed91-4c6b-ade6-0f53b3b46638 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:22.237114 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c2d32bbd-ed91-4c6b-ade6-0f53b3b46638 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:22.372699 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-c2d32bbd-ed91-4c6b-ade6-0f53b3b46638 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:22.382618 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c2d32bbd-ed91-4c6b-ade6-0f53b3b46638 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1682 microversion: 2.1 time: 0.158028 Jul 14 11:47:22.384306 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 219/481] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:22 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:23.042002 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-1ec1f9fe-fb3c-4e5e-976c-60e51e2662d9 req-3c32b91b-b81e-45ca-83f9-bdf4b9b17ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc1d8c0-48e2-49bd-8807-bb041db6a9df", "name": "network-vif-deleted", "tag": "8ec85559-8aa6-4f19-b912-73c9a2d4d487"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:23.054564 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-1ec1f9fe-fb3c-4e5e-976c-60e51e2662d9 req-3c32b91b-b81e-45ca-83f9-bdf4b9b17ed3 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:23.055100 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-1ec1f9fe-fb3c-4e5e-976c-60e51e2662d9 req-3c32b91b-b81e-45ca-83f9-bdf4b9b17ed3 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:23.068742 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-1ec1f9fe-fb3c-4e5e-976c-60e51e2662d9 req-3c32b91b-b81e-45ca-83f9-bdf4b9b17ed3 service nova] Creating event network-vif-deleted:8ec85559-8aa6-4f19-b912-73c9a2d4d487 for instance edc1d8c0-48e2-49bd-8807-bb041db6a9df on hv-cinder-84980 Jul 14 11:47:23.076204 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-1ec1f9fe-fb3c-4e5e-976c-60e51e2662d9 req-3c32b91b-b81e-45ca-83f9-bdf4b9b17ed3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040234 Jul 14 11:47:23.077436 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 263/482] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:47:23.252643 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6006d210-9892-463f-a7cf-a324f1832407 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:23.255646 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-07c633ab-a81c-4194-b6b8-3d210cda5681 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:23.256980 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6006d210-9892-463f-a7cf-a324f1832407 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:23.258089 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-07c633ab-a81c-4194-b6b8-3d210cda5681 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:23.280342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-07c633ab-a81c-4194-b6b8-3d210cda5681 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:23.282752 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6006d210-9892-463f-a7cf-a324f1832407 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:23.283375 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-07c633ab-a81c-4194-b6b8-3d210cda5681 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:23.283800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6006d210-9892-463f-a7cf-a324f1832407 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:23.285968 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-07c633ab-a81c-4194-b6b8-3d210cda5681 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:23.287010 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6006d210-9892-463f-a7cf-a324f1832407 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:23.287496 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-07c633ab-a81c-4194-b6b8-3d210cda5681 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:23.288098 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6006d210-9892-463f-a7cf-a324f1832407 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:23.393251 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6006d210-9892-463f-a7cf-a324f1832407 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:23.405232 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6006d210-9892-463f-a7cf-a324f1832407 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1305 microversion: 2.1 time: 0.160416 Jul 14 11:47:23.412876 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 220/483] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:23 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1305 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:23.418435 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-af6a16cd-c482-4f64-a4f3-934d8d3ffdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:23.419540 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-af6a16cd-c482-4f64-a4f3-934d8d3ffdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:23.426408 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-af6a16cd-c482-4f64-a4f3-934d8d3ffdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:23.428198 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-af6a16cd-c482-4f64-a4f3-934d8d3ffdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:23.434165 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-af6a16cd-c482-4f64-a4f3-934d8d3ffdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:23.436697 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-af6a16cd-c482-4f64-a4f3-934d8d3ffdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:23.486549 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-af6a16cd-c482-4f64-a4f3-934d8d3ffdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:23.487259 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-af6a16cd-c482-4f64-a4f3-934d8d3ffdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:23.487864 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-af6a16cd-c482-4f64-a4f3-934d8d3ffdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lazy-loading 'fault' on Instance uuid edc1d8c0-48e2-49bd-8807-bb041db6a9df {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:47:23.508083 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-07c633ab-a81c-4194-b6b8-3d210cda5681 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:23.517415 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-07c633ab-a81c-4194-b6b8-3d210cda5681 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1668 microversion: 2.1 time: 0.269108 Jul 14 11:47:23.518302 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 264/484] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:23 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1668 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:23.565476 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-af6a16cd-c482-4f64-a4f3-934d8d3ffdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:23.573379 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-af6a16cd-c482-4f64-a4f3-934d8d3ffdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 200 len: 1331 microversion: 2.1 time: 0.159195 Jul 14 11:47:23.574291 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 221/485] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:23 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 1331 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:24.424241 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-4911dcc4-7bb7-41aa-bab7-c9e6f3112a14 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:24.425196 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-4911dcc4-7bb7-41aa-bab7-c9e6f3112a14 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:24.431997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4911dcc4-7bb7-41aa-bab7-c9e6f3112a14 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:24.432456 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4911dcc4-7bb7-41aa-bab7-c9e6f3112a14 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:24.433448 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4911dcc4-7bb7-41aa-bab7-c9e6f3112a14 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:24.433924 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4911dcc4-7bb7-41aa-bab7-c9e6f3112a14 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:24.581374 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-4911dcc4-7bb7-41aa-bab7-c9e6f3112a14 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:24.589512 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-4911dcc4-7bb7-41aa-bab7-c9e6f3112a14 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1370 microversion: 2.1 time: 0.170208 Jul 14 11:47:24.597591 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 265/486] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:24 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:24.598052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-96358e24-364e-4397-8e7f-6a321aa3411e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:24.598983 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-96358e24-364e-4397-8e7f-6a321aa3411e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:24.611021 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96358e24-364e-4397-8e7f-6a321aa3411e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:24.611972 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96358e24-364e-4397-8e7f-6a321aa3411e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:24.613386 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96358e24-364e-4397-8e7f-6a321aa3411e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:24.614052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96358e24-364e-4397-8e7f-6a321aa3411e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:24.631570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-96358e24-364e-4397-8e7f-6a321aa3411e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] HTTP exception thrown: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-96358e24-364e-4397-8e7f-6a321aa3411e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Request method failure captured: Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df HTTP/1.1 Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGNrCXQELDmNK7QTgAsdlJtPBM_GXw3pFQ92I5FXg_Nl7xnN8erDQ0jD6cBgqZwNWgSGDIvH_OU-IJPWW0i2GmYKcnE8wD4a47a9DJeOO5JgDloTkiJ3A6EcxYhG-symYmW7J8b_ws3S47CzQaA9KAgAK_QrTjwz8qGsPABa7uBQLs Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:47:24.633384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:47:24.634923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f274d555f5c746cc885394c699b3d767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f274d555f5c746cc885394c699b3d767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:47:24.634923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:47:24.634923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:47:24.634923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:47:24.634923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:47:24.634923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:47:24.634923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:47:24.634923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 8773c88f88614a9d903f667305a217e0 Jul 14 11:47:24.634923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:47:24.634923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:47:24.634923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. Jul 14 11:47:24.634923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': 'edc1d8c0-48e2-49bd-8807-bb041db6a9df'} Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:47:24.635713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. Jul 14 11:47:24.637094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:47:24.638329 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-96358e24-364e-4397-8e7f-6a321aa3411e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Returning 404 to user: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:47:24.638329 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-96358e24-364e-4397-8e7f-6a321aa3411e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 404 len: 111 microversion: 2.1 time: 0.042800 Jul 14 11:47:24.638329 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 222/487] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:24 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:47:24.646557 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-399fed49-f12c-499e-8652-1cde4d3f0926 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '.version_select at 0x7f1adf783310>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:24.712000 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-399fed49-f12c-499e-8652-1cde4d3f0926 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718795879" status: 202 len: 0 microversion: 2.1 time: 0.069399 Jul 14 11:47:24.717837 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 266/488] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jul 14 11:47:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718795879 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:47:25.178616 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-9baabf38-906b-4dfc-a53d-7bedfa74d163 req-3852f55f-3d93-48bb-86c4-42ab229276d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c667180-b390-45de-b693-7d59b8369eb6", "tag": "941e85d3-a14c-4664-99a5-c7fce2347e18"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:25.178616 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-9baabf38-906b-4dfc-a53d-7bedfa74d163 req-3852f55f-3d93-48bb-86c4-42ab229276d8 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:25.178616 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-9baabf38-906b-4dfc-a53d-7bedfa74d163 req-3852f55f-3d93-48bb-86c4-42ab229276d8 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:25.178616 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-9baabf38-906b-4dfc-a53d-7bedfa74d163 req-3852f55f-3d93-48bb-86c4-42ab229276d8 service nova] Creating event network-changed:941e85d3-a14c-4664-99a5-c7fce2347e18 for instance 1c667180-b390-45de-b693-7d59b8369eb6 on hv-cinder-84980 Jul 14 11:47:25.179309 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-9baabf38-906b-4dfc-a53d-7bedfa74d163 req-3852f55f-3d93-48bb-86c4-42ab229276d8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033041 Jul 14 11:47:25.179309 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 223/489] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:47:25.614034 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-14d410f4-1a13-40c3-a504-3aab4836801d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:25.614674 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-14d410f4-1a13-40c3-a504-3aab4836801d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:25.621365 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-14d410f4-1a13-40c3-a504-3aab4836801d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:25.621809 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-14d410f4-1a13-40c3-a504-3aab4836801d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:25.622587 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-14d410f4-1a13-40c3-a504-3aab4836801d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:25.623014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-14d410f4-1a13-40c3-a504-3aab4836801d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:25.775738 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-14d410f4-1a13-40c3-a504-3aab4836801d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:25.783695 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-14d410f4-1a13-40c3-a504-3aab4836801d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1370 microversion: 2.1 time: 0.173786 Jul 14 11:47:25.784658 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 267/490] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:25 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:26.135001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5ab7c0f4-3218-4d0f-a003-af4d1b2759b5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Action: 'create', calling method: .version_select at 0x7f1ae434a5e0>, body: {"keypair": {"name": "tempest-keypair-107821029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAThey6rzvwf8UacDtjfsOetrjTtT2OMRbFdhSHlFer/JuLTvoJij3AIbcMY9taMfrf3ZYH4CgaPNZiQoEQqSVYQozyPBdSCqjg8PXm3GFvtugbQZsBSifmZJdS3nsCV7w=="}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:26.151341 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-5ab7c0f4-3218-4d0f-a003-af4d1b2759b5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for project f274d555f5c746cc885394c699b3d767. Resources: {'key_pairs'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:47:26.156698 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-5ab7c0f4-3218-4d0f-a003-af4d1b2759b5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for user 8773c88f88614a9d903f667305a217e0 and project f274d555f5c746cc885394c699b3d767. Resources: {'key_pairs'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:47:26.279772 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5ab7c0f4-3218-4d0f-a003-af4d1b2759b5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.148908 Jul 14 11:47:26.286506 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 224/491] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 11:47:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:47:26.802234 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5dba71b8-dd37-4be6-81c0-53d318028d4c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:26.802925 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-5dba71b8-dd37-4be6-81c0-53d318028d4c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:26.809132 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5dba71b8-dd37-4be6-81c0-53d318028d4c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:26.810402 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5dba71b8-dd37-4be6-81c0-53d318028d4c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:26.810402 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5dba71b8-dd37-4be6-81c0-53d318028d4c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:26.810775 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5dba71b8-dd37-4be6-81c0-53d318028d4c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:26.968656 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-5dba71b8-dd37-4be6-81c0-53d318028d4c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:26.977374 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-5dba71b8-dd37-4be6-81c0-53d318028d4c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1370 microversion: 2.1 time: 0.178911 Jul 14 11:47:26.979302 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 268/492] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:26 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:27.995107 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-2e2d2c98-9cf0-4ea6-9fe7-051c231cf7a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:27.999264 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-2e2d2c98-9cf0-4ea6-9fe7-051c231cf7a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:28.004273 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2e2d2c98-9cf0-4ea6-9fe7-051c231cf7a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:28.004722 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2e2d2c98-9cf0-4ea6-9fe7-051c231cf7a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:28.005919 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2e2d2c98-9cf0-4ea6-9fe7-051c231cf7a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:28.006364 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2e2d2c98-9cf0-4ea6-9fe7-051c231cf7a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:28.300973 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-2e2d2c98-9cf0-4ea6-9fe7-051c231cf7a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:28.308780 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-2e2d2c98-9cf0-4ea6-9fe7-051c231cf7a5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1370 microversion: 2.1 time: 0.318152 Jul 14 11:47:28.319705 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 225/493] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:27 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1370 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:29.327428 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a111fe79-5331-43d5-ad37-27b4d55d4d91 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:29.331919 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a111fe79-5331-43d5-ad37-27b4d55d4d91 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:29.336063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:29.337024 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:29.342774 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a111fe79-5331-43d5-ad37-27b4d55d4d91 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:29.347561 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a111fe79-5331-43d5-ad37-27b4d55d4d91 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:29.348902 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a111fe79-5331-43d5-ad37-27b4d55d4d91 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:29.350468 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a111fe79-5331-43d5-ad37-27b4d55d4d91 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:29.528612 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a111fe79-5331-43d5-ad37-27b4d55d4d91 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:29.537463 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a111fe79-5331-43d5-ad37-27b4d55d4d91 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1370 microversion: 2.1 time: 0.213974 Jul 14 11:47:29.538485 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 269/494] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:29 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:29.931713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1007056010", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce6397ea-e1d9-4c18-9185-6161e76618d7"}], "security_groups": [{"name": "tempest-securitygroup--20643343"}], "key_name": "tempest-keypair-107821029", "user_data": "}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:29.940399 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:30.054425 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.network.neutron [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] validate_networks() for [('ce6397ea-e1d9-4c18-9185-6161e76618d7', None, None, None, None, None)] {{(pid=124946) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:47:30.531885 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Flavor limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:47:30.532597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Image limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:47:30.533409 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Flavor pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:47:30.533928 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Image pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:47:30.535026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:47:30.547777 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:30.549832 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:30.550775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:30.551462 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:30.555432 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-00bf9107-dbef-4369-b4f8-ac29434f4434 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:30.556624 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-00bf9107-dbef-4369-b4f8-ac29434f4434 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:30.563891 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-00bf9107-dbef-4369-b4f8-ac29434f4434 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:30.566871 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-00bf9107-dbef-4369-b4f8-ac29434f4434 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:30.566871 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-00bf9107-dbef-4369-b4f8-ac29434f4434 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:30.566871 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-00bf9107-dbef-4369-b4f8-ac29434f4434 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:30.572482 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for project f274d555f5c746cc885394c699b3d767. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:47:30.579294 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for user 8773c88f88614a9d903f667305a217e0 and project f274d555f5c746cc885394c699b3d767. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:47:30.594227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Going to run 1 instances... {{(pid=124946) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:47:30.597771 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124946) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:47:30.742731 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-be7950df-dab5-42f1-a224-0976b1b394c0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.814999 Jul 14 11:47:30.744041 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 226/495] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:47:29 2022] POST /compute/v2.1/servers => generated 400 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:47:30.758131 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-17590709-c105-4e07-a324-cb4d6b42fbed tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:30.759032 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-17590709-c105-4e07-a324-cb4d6b42fbed tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:30.813456 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-00bf9107-dbef-4369-b4f8-ac29434f4434 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:30.823593 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-00bf9107-dbef-4369-b4f8-ac29434f4434 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1370 microversion: 2.1 time: 0.271962 Jul 14 11:47:30.827197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 270/496] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:30 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1370 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:30.843444 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-17590709-c105-4e07-a324-cb4d6b42fbed tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:30.851831 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-17590709-c105-4e07-a324-cb4d6b42fbed tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1241 microversion: 2.1 time: 0.100523 Jul 14 11:47:30.853135 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 227/497] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:30 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:31.291202 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-b7aedb3b-de2f-4915-8561-c1de19197ab1 req-20d4b950-6ecd-468b-957d-80835216c6cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c667180-b390-45de-b693-7d59b8369eb6", "name": "network-vif-plugged", "status": "completed", "tag": "941e85d3-a14c-4664-99a5-c7fce2347e18"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:31.299291 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-b7aedb3b-de2f-4915-8561-c1de19197ab1 req-20d4b950-6ecd-468b-957d-80835216c6cd service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:31.299735 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-b7aedb3b-de2f-4915-8561-c1de19197ab1 req-20d4b950-6ecd-468b-957d-80835216c6cd service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:31.310853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-b7aedb3b-de2f-4915-8561-c1de19197ab1 req-20d4b950-6ecd-468b-957d-80835216c6cd service nova] Creating event network-vif-plugged:941e85d3-a14c-4664-99a5-c7fce2347e18 for instance 1c667180-b390-45de-b693-7d59b8369eb6 on hv-cinder-84980 Jul 14 11:47:31.316668 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-b7aedb3b-de2f-4915-8561-c1de19197ab1 req-20d4b950-6ecd-468b-957d-80835216c6cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029083 Jul 14 11:47:31.317387 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 271/498] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:47:31.839830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-eb136eb0-d48c-4f20-add9-45b8f1077ae2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:31.841039 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-eb136eb0-d48c-4f20-add9-45b8f1077ae2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:31.849198 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-eb136eb0-d48c-4f20-add9-45b8f1077ae2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:31.849642 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-eb136eb0-d48c-4f20-add9-45b8f1077ae2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:31.850420 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-eb136eb0-d48c-4f20-add9-45b8f1077ae2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:31.850850 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-eb136eb0-d48c-4f20-add9-45b8f1077ae2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:31.870912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-4de31fda-10dc-46f6-91ba-7ea000f66a61 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:31.871607 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-4de31fda-10dc-46f6-91ba-7ea000f66a61 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:31.878383 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4de31fda-10dc-46f6-91ba-7ea000f66a61 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:31.879113 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4de31fda-10dc-46f6-91ba-7ea000f66a61 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:31.880336 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4de31fda-10dc-46f6-91ba-7ea000f66a61 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:31.881975 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4de31fda-10dc-46f6-91ba-7ea000f66a61 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:31.990466 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-4de31fda-10dc-46f6-91ba-7ea000f66a61 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:31.999385 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-4de31fda-10dc-46f6-91ba-7ea000f66a61 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1245 microversion: 2.1 time: 0.132982 Jul 14 11:47:32.000658 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 272/499] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:31 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1245 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:32.013358 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-eb136eb0-d48c-4f20-add9-45b8f1077ae2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:32.021665 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-eb136eb0-d48c-4f20-add9-45b8f1077ae2 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1370 microversion: 2.1 time: 0.185557 Jul 14 11:47:32.022758 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 228/500] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:31 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:33.017221 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7d48e7eb-c85e-4045-bfa2-56d572bc2d56 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:33.017839 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7d48e7eb-c85e-4045-bfa2-56d572bc2d56 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:33.024774 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7d48e7eb-c85e-4045-bfa2-56d572bc2d56 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:33.025242 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7d48e7eb-c85e-4045-bfa2-56d572bc2d56 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:33.026024 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7d48e7eb-c85e-4045-bfa2-56d572bc2d56 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:33.026456 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7d48e7eb-c85e-4045-bfa2-56d572bc2d56 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:33.039572 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-16b0998c-7356-4811-ab8b-be9864367a2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:33.040189 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-16b0998c-7356-4811-ab8b-be9864367a2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:33.047630 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-16b0998c-7356-4811-ab8b-be9864367a2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:33.048070 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-16b0998c-7356-4811-ab8b-be9864367a2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:33.049040 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-16b0998c-7356-4811-ab8b-be9864367a2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:33.049501 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-16b0998c-7356-4811-ab8b-be9864367a2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:33.121341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7d48e7eb-c85e-4045-bfa2-56d572bc2d56 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:33.130809 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7d48e7eb-c85e-4045-bfa2-56d572bc2d56 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1293 microversion: 2.1 time: 0.117627 Jul 14 11:47:33.131663 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 273/501] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:33 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1293 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:33.227793 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-16b0998c-7356-4811-ab8b-be9864367a2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:33.236492 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-16b0998c-7356-4811-ab8b-be9864367a2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1370 microversion: 2.1 time: 0.200769 Jul 14 11:47:33.237380 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 229/502] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:33 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:34.155776 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-68b52531-1d89-4f3f-a483-0a4caa728260 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:34.156375 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-68b52531-1d89-4f3f-a483-0a4caa728260 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:34.162891 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-68b52531-1d89-4f3f-a483-0a4caa728260 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:34.163340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-68b52531-1d89-4f3f-a483-0a4caa728260 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:34.164122 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-68b52531-1d89-4f3f-a483-0a4caa728260 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:34.164567 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-68b52531-1d89-4f3f-a483-0a4caa728260 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:34.229092 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-68b52531-1d89-4f3f-a483-0a4caa728260 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:34.237006 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-68b52531-1d89-4f3f-a483-0a4caa728260 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1301 microversion: 2.1 time: 0.084872 Jul 14 11:47:34.237515 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 274/503] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:34 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1301 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:34.254016 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5343f0a4-4e35-435f-9dcb-0ffa6f53db45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:34.254637 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5343f0a4-4e35-435f-9dcb-0ffa6f53db45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:34.261500 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5343f0a4-4e35-435f-9dcb-0ffa6f53db45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:34.261957 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5343f0a4-4e35-435f-9dcb-0ffa6f53db45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:34.262735 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5343f0a4-4e35-435f-9dcb-0ffa6f53db45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:34.263407 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5343f0a4-4e35-435f-9dcb-0ffa6f53db45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:34.268536 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:34.581110 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5343f0a4-4e35-435f-9dcb-0ffa6f53db45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:34.591932 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5343f0a4-4e35-435f-9dcb-0ffa6f53db45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1563 microversion: 2.1 time: 0.342125 Jul 14 11:47:34.592698 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 230/504] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:34 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1563 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:34.610299 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-cba228ab-e5a6-4a7c-b1f6-dce07b1c6021 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:34.613147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-cba228ab-e5a6-4a7c-b1f6-dce07b1c6021 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:34.621760 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cba228ab-e5a6-4a7c-b1f6-dce07b1c6021 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:34.622897 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cba228ab-e5a6-4a7c-b1f6-dce07b1c6021 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:34.623464 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cba228ab-e5a6-4a7c-b1f6-dce07b1c6021 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:34.628826 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cba228ab-e5a6-4a7c-b1f6-dce07b1c6021 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:35.048370 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-cba228ab-e5a6-4a7c-b1f6-dce07b1c6021 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.440135 Jul 14 11:47:35.048370 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 275/505] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jul 14 11:47:34 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-interface => generated 284 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:47:35.267004 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d0e50251-9583-4186-a4dc-14693fdd4ac6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:35.270208 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d0e50251-9583-4186-a4dc-14693fdd4ac6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:35.288881 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:35.291545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d0e50251-9583-4186-a4dc-14693fdd4ac6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:35.292011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d0e50251-9583-4186-a4dc-14693fdd4ac6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:35.292811 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d0e50251-9583-4186-a4dc-14693fdd4ac6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:35.293312 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d0e50251-9583-4186-a4dc-14693fdd4ac6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:35.626526 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d0e50251-9583-4186-a4dc-14693fdd4ac6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:35.640136 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d0e50251-9583-4186-a4dc-14693fdd4ac6 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1365 microversion: 2.1 time: 0.380765 Jul 14 11:47:35.644003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 231/506] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:35 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1365 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:36.660825 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-43d55bbb-77cc-4559-8cc7-44c110240b5b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:36.662607 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-43d55bbb-77cc-4559-8cc7-44c110240b5b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:36.670229 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-43d55bbb-77cc-4559-8cc7-44c110240b5b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:36.671419 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-43d55bbb-77cc-4559-8cc7-44c110240b5b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:36.676526 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-43d55bbb-77cc-4559-8cc7-44c110240b5b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:36.676526 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-43d55bbb-77cc-4559-8cc7-44c110240b5b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:36.915885 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-31257c4f-762c-49cd-8b1e-f62029610890 req-a1874184-3769-4bfc-91f7-9d5d3b7161aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72ebe862-edb8-480e-9c0d-02a791c8160b", "tag": "5e6cb4bd-c1db-46aa-aa0f-3f63a312e386"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:36.939319 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-31257c4f-762c-49cd-8b1e-f62029610890 req-a1874184-3769-4bfc-91f7-9d5d3b7161aa service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:36.940299 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-31257c4f-762c-49cd-8b1e-f62029610890 req-a1874184-3769-4bfc-91f7-9d5d3b7161aa service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:36.986666 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-31257c4f-762c-49cd-8b1e-f62029610890 req-a1874184-3769-4bfc-91f7-9d5d3b7161aa service nova] Creating event network-changed:5e6cb4bd-c1db-46aa-aa0f-3f63a312e386 for instance 72ebe862-edb8-480e-9c0d-02a791c8160b on hv-cinder-84980 Jul 14 11:47:36.996289 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-31257c4f-762c-49cd-8b1e-f62029610890 req-a1874184-3769-4bfc-91f7-9d5d3b7161aa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086691 Jul 14 11:47:36.997500 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 232/507] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:47:37.044562 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-43d55bbb-77cc-4559-8cc7-44c110240b5b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:37.074148 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-43d55bbb-77cc-4559-8cc7-44c110240b5b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1365 microversion: 2.1 time: 0.419676 Jul 14 11:47:37.085724 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 276/508] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:36 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1365 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:37.283572 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-a2cdb0db-555b-4af7-80e1-d75d6c70dad4 req-cb44bd9f-dcd6-4957-a40a-8318d94f5067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c667180-b390-45de-b693-7d59b8369eb6", "tag": "941e85d3-a14c-4664-99a5-c7fce2347e18"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:37.300547 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-a2cdb0db-555b-4af7-80e1-d75d6c70dad4 req-cb44bd9f-dcd6-4957-a40a-8318d94f5067 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:37.301247 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-a2cdb0db-555b-4af7-80e1-d75d6c70dad4 req-cb44bd9f-dcd6-4957-a40a-8318d94f5067 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:37.319134 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-a2cdb0db-555b-4af7-80e1-d75d6c70dad4 req-cb44bd9f-dcd6-4957-a40a-8318d94f5067 service nova] Creating event network-changed:941e85d3-a14c-4664-99a5-c7fce2347e18 for instance 1c667180-b390-45de-b693-7d59b8369eb6 on hv-cinder-84980 Jul 14 11:47:37.324816 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-a2cdb0db-555b-4af7-80e1-d75d6c70dad4 req-cb44bd9f-dcd6-4957-a40a-8318d94f5067 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047200 Jul 14 11:47:37.325950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 233/509] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:47:38.092048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c649441d-22fb-4503-a544-f2883a135646 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:38.093354 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c649441d-22fb-4503-a544-f2883a135646 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:38.100160 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c649441d-22fb-4503-a544-f2883a135646 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:38.100868 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c649441d-22fb-4503-a544-f2883a135646 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:38.102366 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c649441d-22fb-4503-a544-f2883a135646 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:38.102803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c649441d-22fb-4503-a544-f2883a135646 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:38.133197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:38.272331 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c649441d-22fb-4503-a544-f2883a135646 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:38.281187 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c649441d-22fb-4503-a544-f2883a135646 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1365 microversion: 2.1 time: 0.192967 Jul 14 11:47:38.285186 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 277/510] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:38 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:39.301379 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-de690395-ff28-46c2-ae0a-7fedbb1daec5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:39.302092 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-de690395-ff28-46c2-ae0a-7fedbb1daec5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:39.314258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-de690395-ff28-46c2-ae0a-7fedbb1daec5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:39.314705 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-de690395-ff28-46c2-ae0a-7fedbb1daec5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:39.315481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-de690395-ff28-46c2-ae0a-7fedbb1daec5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:39.316251 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-de690395-ff28-46c2-ae0a-7fedbb1daec5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:39.671853 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-de690395-ff28-46c2-ae0a-7fedbb1daec5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:39.679792 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-de690395-ff28-46c2-ae0a-7fedbb1daec5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1365 microversion: 2.1 time: 0.384454 Jul 14 11:47:39.681776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 234/511] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:39 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1365 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:40.698602 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-661d3e2e-88ac-480f-8c74-2d9ba6adf498 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:40.699908 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-661d3e2e-88ac-480f-8c74-2d9ba6adf498 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:40.706911 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-661d3e2e-88ac-480f-8c74-2d9ba6adf498 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:40.707627 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-661d3e2e-88ac-480f-8c74-2d9ba6adf498 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:40.708463 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-661d3e2e-88ac-480f-8c74-2d9ba6adf498 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:40.708983 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-661d3e2e-88ac-480f-8c74-2d9ba6adf498 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:40.905066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-661d3e2e-88ac-480f-8c74-2d9ba6adf498 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:40.915232 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-661d3e2e-88ac-480f-8c74-2d9ba6adf498 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1365 microversion: 2.1 time: 0.220633 Jul 14 11:47:40.916250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 278/512] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:40 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:41.932322 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b7031625-4929-4420-933f-8d708b8db6fa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:41.932940 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b7031625-4929-4420-933f-8d708b8db6fa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:41.935730 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:41.936433 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=22 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:47:41.943107 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b7031625-4929-4420-933f-8d708b8db6fa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:41.943921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b7031625-4929-4420-933f-8d708b8db6fa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:41.945016 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b7031625-4929-4420-933f-8d708b8db6fa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:41.945628 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b7031625-4929-4420-933f-8d708b8db6fa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:42.093035 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b7031625-4929-4420-933f-8d708b8db6fa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:42.101603 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b7031625-4929-4420-933f-8d708b8db6fa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1365 microversion: 2.1 time: 0.172983 Jul 14 11:47:42.102220 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 235/513] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:41 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:43.056406 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-0968106b-3d8e-4c69-8b4e-241b8162e6be req-a70d0e5b-17a3-4312-8a57-00bcbcecb9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ebe862-edb8-480e-9c0d-02a791c8160b", "name": "network-vif-plugged", "status": "completed", "tag": "5e6cb4bd-c1db-46aa-aa0f-3f63a312e386"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:43.072893 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-0968106b-3d8e-4c69-8b4e-241b8162e6be req-a70d0e5b-17a3-4312-8a57-00bcbcecb9d6 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:43.075814 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-0968106b-3d8e-4c69-8b4e-241b8162e6be req-a70d0e5b-17a3-4312-8a57-00bcbcecb9d6 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:43.106476 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-0968106b-3d8e-4c69-8b4e-241b8162e6be req-a70d0e5b-17a3-4312-8a57-00bcbcecb9d6 service nova] Creating event network-vif-plugged:5e6cb4bd-c1db-46aa-aa0f-3f63a312e386 for instance 72ebe862-edb8-480e-9c0d-02a791c8160b on hv-cinder-84980 Jul 14 11:47:43.120270 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-96b84404-536d-43dc-ab5b-f4831198e5e9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:43.121717 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-96b84404-536d-43dc-ab5b-f4831198e5e9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:43.133729 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96b84404-536d-43dc-ab5b-f4831198e5e9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:43.137660 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-0968106b-3d8e-4c69-8b4e-241b8162e6be req-a70d0e5b-17a3-4312-8a57-00bcbcecb9d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094965 Jul 14 11:47:43.139184 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96b84404-536d-43dc-ab5b-f4831198e5e9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:43.139339 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 279/514] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:47:43.140223 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96b84404-536d-43dc-ab5b-f4831198e5e9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:43.140814 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-96b84404-536d-43dc-ab5b-f4831198e5e9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:43.372879 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-96b84404-536d-43dc-ab5b-f4831198e5e9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:43.388511 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-96b84404-536d-43dc-ab5b-f4831198e5e9 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1365 microversion: 2.1 time: 0.272710 Jul 14 11:47:43.399092 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 236/515] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:43 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:44.407317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-bf005513-e894-4843-9842-56b10fa823d3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:44.407999 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-bf005513-e894-4843-9842-56b10fa823d3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:44.414835 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bf005513-e894-4843-9842-56b10fa823d3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:44.415277 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bf005513-e894-4843-9842-56b10fa823d3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:44.416051 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bf005513-e894-4843-9842-56b10fa823d3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:44.416481 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bf005513-e894-4843-9842-56b10fa823d3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:44.596448 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-bf005513-e894-4843-9842-56b10fa823d3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:44.609870 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-bf005513-e894-4843-9842-56b10fa823d3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1365 microversion: 2.1 time: 0.206135 Jul 14 11:47:44.610192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 280/516] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:44 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:45.632544 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-dd13d8da-dfa4-4147-9b71-ebf1cc1ad0f8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:45.633257 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-dd13d8da-dfa4-4147-9b71-ebf1cc1ad0f8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:45.639984 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd13d8da-dfa4-4147-9b71-ebf1cc1ad0f8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:45.643864 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd13d8da-dfa4-4147-9b71-ebf1cc1ad0f8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:45.643864 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd13d8da-dfa4-4147-9b71-ebf1cc1ad0f8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:45.643864 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd13d8da-dfa4-4147-9b71-ebf1cc1ad0f8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:45.799976 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-dd13d8da-dfa4-4147-9b71-ebf1cc1ad0f8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:45.807391 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-dd13d8da-dfa4-4147-9b71-ebf1cc1ad0f8 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1365 microversion: 2.1 time: 0.178806 Jul 14 11:47:45.807958 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 237/517] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:45 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:46.824497 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c22871ed-4f2c-4f63-966b-15e2aeb6059c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:46.825738 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c22871ed-4f2c-4f63-966b-15e2aeb6059c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:46.833734 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c22871ed-4f2c-4f63-966b-15e2aeb6059c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:46.834424 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c22871ed-4f2c-4f63-966b-15e2aeb6059c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:46.835378 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c22871ed-4f2c-4f63-966b-15e2aeb6059c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:46.835814 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c22871ed-4f2c-4f63-966b-15e2aeb6059c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:46.997604 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c22871ed-4f2c-4f63-966b-15e2aeb6059c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:47.006200 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c22871ed-4f2c-4f63-966b-15e2aeb6059c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1555 microversion: 2.1 time: 0.185543 Jul 14 11:47:47.007052 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 281/518] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:46 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:47.024618 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-24fa3e36-7a73-41b9-b557-1c4ec6d5e429 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:47.025827 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-24fa3e36-7a73-41b9-b557-1c4ec6d5e429 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:47.032768 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-24fa3e36-7a73-41b9-b557-1c4ec6d5e429 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:47.033361 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-24fa3e36-7a73-41b9-b557-1c4ec6d5e429 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:47.034281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-24fa3e36-7a73-41b9-b557-1c4ec6d5e429 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:47.034813 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-24fa3e36-7a73-41b9-b557-1c4ec6d5e429 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:47.129306 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-24fa3e36-7a73-41b9-b557-1c4ec6d5e429 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108747 Jul 14 11:47:47.129907 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 238/519] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jul 14 11:47:47 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:47:48.239037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-978a6aca-aa79-4b9d-afbf-69c7571458e4 req-2235b2a9-5b87-4984-83ec-92d7e5d74390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72ebe862-edb8-480e-9c0d-02a791c8160b", "tag": "5e6cb4bd-c1db-46aa-aa0f-3f63a312e386"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:48.248134 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-978a6aca-aa79-4b9d-afbf-69c7571458e4 req-2235b2a9-5b87-4984-83ec-92d7e5d74390 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:48.248873 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-978a6aca-aa79-4b9d-afbf-69c7571458e4 req-2235b2a9-5b87-4984-83ec-92d7e5d74390 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:48.262951 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-978a6aca-aa79-4b9d-afbf-69c7571458e4 req-2235b2a9-5b87-4984-83ec-92d7e5d74390 service nova] Creating event network-changed:5e6cb4bd-c1db-46aa-aa0f-3f63a312e386 for instance 72ebe862-edb8-480e-9c0d-02a791c8160b on hv-cinder-84980 Jul 14 11:47:48.268376 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-978a6aca-aa79-4b9d-afbf-69c7571458e4 req-2235b2a9-5b87-4984-83ec-92d7e5d74390 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033692 Jul 14 11:47:48.269282 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 282/520] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:47:52.698981 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ffbbeeec-44c3-4fa3-80c9-a3644b616e0e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Action: 'create', calling method: .version_select at 0x7f1adf6580d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-65159567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzuG4/gz1408/Dwk+dI7l8mH+3qN+DVBqZtDFQ401rcUHi7hgkjj26cgvLsNxMz4P1lfFTPSKDG2yytFVWfU67oCI9zEVUXqUgLLtQ822Lmon8hKIfR3byFRxfE8igWA=="}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:52.713811 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-ffbbeeec-44c3-4fa3-80c9-a3644b616e0e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Getting quotas for project dc22323158714269b0da2b01121fe3ed. Resources: {'key_pairs'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:47:52.718106 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-ffbbeeec-44c3-4fa3-80c9-a3644b616e0e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Getting quotas for user 59ebb8f1e98d40c9aea425fad464f1e3 and project dc22323158714269b0da2b01121fe3ed. Resources: {'key_pairs'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:47:52.866917 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ffbbeeec-44c3-4fa3-80c9-a3644b616e0e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.172928 Jul 14 11:47:52.867627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 239/521] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 11:47:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:47:52.917382 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1872306358", "imageRef": "f03589f7-6d2f-4e51-9de7-a63daf1623b2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-65159567", "networks": [{"uuid": "5ac6cc6a-1ccb-4a85-8137-dbb90845a5b7"}]}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:47:52.967885 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.network.neutron [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] validate_networks() for [('5ac6cc6a-1ccb-4a85-8137-dbb90845a5b7', None, None, None, None, None)] {{(pid=124947) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:47:53.348646 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Flavor limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:47:53.349074 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Image limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:47:53.349621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Flavor pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:47:53.350027 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Image pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:47:53.350434 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:47:53.359457 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:53.359912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:53.360711 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:53.361145 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:53.378261 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Getting quotas for project dc22323158714269b0da2b01121fe3ed. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:47:53.382286 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Getting quotas for user 59ebb8f1e98d40c9aea425fad464f1e3 and project dc22323158714269b0da2b01121fe3ed. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:47:53.393899 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Going to run 1 instances... {{(pid=124947) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:47:53.396200 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f03589f7-6d2f-4e51-9de7-a63daf1623b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:47:53.518359 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-847e2742-62f2-47fe-9352-3369296611e5 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604700 Jul 14 11:47:53.519001 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 283/522] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:47:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:47:53.529276 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d9751e9c-6efa-48c7-809a-3b29e4c5f7fb tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:53.530019 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d9751e9c-6efa-48c7-809a-3b29e4c5f7fb tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:53.585648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d9751e9c-6efa-48c7-809a-3b29e4c5f7fb tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:53.592779 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d9751e9c-6efa-48c7-809a-3b29e4c5f7fb tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1257 microversion: 2.1 time: 0.067501 Jul 14 11:47:53.593440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 240/523] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:53 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:54.609913 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-4b753887-84e4-4ba9-a8e7-2f2f23e9d66a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:54.610560 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-4b753887-84e4-4ba9-a8e7-2f2f23e9d66a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:54.617476 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4b753887-84e4-4ba9-a8e7-2f2f23e9d66a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:54.617927 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4b753887-84e4-4ba9-a8e7-2f2f23e9d66a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:54.618697 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4b753887-84e4-4ba9-a8e7-2f2f23e9d66a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:54.619155 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4b753887-84e4-4ba9-a8e7-2f2f23e9d66a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:54.681756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-4b753887-84e4-4ba9-a8e7-2f2f23e9d66a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:54.689388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-4b753887-84e4-4ba9-a8e7-2f2f23e9d66a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1261 microversion: 2.1 time: 0.083543 Jul 14 11:47:54.689988 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 284/524] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:54 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:55.706418 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-8e45d8b0-6bab-4ef1-8547-baaf3574c4e3 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:55.707020 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-8e45d8b0-6bab-4ef1-8547-baaf3574c4e3 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:55.714474 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8e45d8b0-6bab-4ef1-8547-baaf3574c4e3 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:55.714927 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8e45d8b0-6bab-4ef1-8547-baaf3574c4e3 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:55.715693 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8e45d8b0-6bab-4ef1-8547-baaf3574c4e3 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:55.716122 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8e45d8b0-6bab-4ef1-8547-baaf3574c4e3 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:55.777936 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8e45d8b0-6bab-4ef1-8547-baaf3574c4e3 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:55.785840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-8e45d8b0-6bab-4ef1-8547-baaf3574c4e3 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1309 microversion: 2.1 time: 0.083430 Jul 14 11:47:55.786404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 241/525] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:55 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1309 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:47:56.805545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7dbcd116-515d-4846-992a-335d38957bbe tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:56.806139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7dbcd116-515d-4846-992a-335d38957bbe tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:56.812151 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7dbcd116-515d-4846-992a-335d38957bbe tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:56.812595 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7dbcd116-515d-4846-992a-335d38957bbe tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:56.813510 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7dbcd116-515d-4846-992a-335d38957bbe tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:56.813960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7dbcd116-515d-4846-992a-335d38957bbe tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:56.971228 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7dbcd116-515d-4846-992a-335d38957bbe tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:56.979637 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7dbcd116-515d-4846-992a-335d38957bbe tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.181125 Jul 14 11:47:56.980550 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 285/526] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:56 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:57.997509 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-fb91ed18-d49c-4501-8ed4-8289d5012c5f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:57.998084 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-fb91ed18-d49c-4501-8ed4-8289d5012c5f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:58.005068 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fb91ed18-d49c-4501-8ed4-8289d5012c5f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:58.005604 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fb91ed18-d49c-4501-8ed4-8289d5012c5f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:58.006356 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fb91ed18-d49c-4501-8ed4-8289d5012c5f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:58.006787 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fb91ed18-d49c-4501-8ed4-8289d5012c5f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:58.142364 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-fb91ed18-d49c-4501-8ed4-8289d5012c5f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:58.151027 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-fb91ed18-d49c-4501-8ed4-8289d5012c5f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.157406 Jul 14 11:47:58.151615 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 242/527] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:57 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:59.167972 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-e10e0b56-71f1-49c1-9cbf-28a57c5f6a1b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:59.169501 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-e10e0b56-71f1-49c1-9cbf-28a57c5f6a1b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:59.176150 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e10e0b56-71f1-49c1-9cbf-28a57c5f6a1b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:59.176600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e10e0b56-71f1-49c1-9cbf-28a57c5f6a1b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:59.177630 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e10e0b56-71f1-49c1-9cbf-28a57c5f6a1b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:59.178069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e10e0b56-71f1-49c1-9cbf-28a57c5f6a1b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:59.322896 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e10e0b56-71f1-49c1-9cbf-28a57c5f6a1b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:47:59.331211 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-e10e0b56-71f1-49c1-9cbf-28a57c5f6a1b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.166548 Jul 14 11:47:59.331802 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 286/528] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:47:59 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:47:59.521337 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-993c51fc-3259-4dab-8cfa-4715d9e6553b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:59.521915 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-993c51fc-3259-4dab-8cfa-4715d9e6553b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:59.528439 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-993c51fc-3259-4dab-8cfa-4715d9e6553b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:59.528889 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-993c51fc-3259-4dab-8cfa-4715d9e6553b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:59.529699 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-993c51fc-3259-4dab-8cfa-4715d9e6553b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:59.530136 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-993c51fc-3259-4dab-8cfa-4715d9e6553b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:59.562356 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-993c51fc-3259-4dab-8cfa-4715d9e6553b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments/6d795e08-02e9-4806-8318-00afb9081e45" status: 200 len: 194 microversion: 2.20 time: 0.046185 Jul 14 11:47:59.563999 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 243/529] 10.222.0.40 () {60 vars in 1453 bytes} [Thu Jul 14 11:47:59 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments/6d795e08-02e9-4806-8318-00afb9081e45 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:47:59.629889 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9e3dffb0-499e-40a9-bf99-9b515f6f5807 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:59.630478 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9e3dffb0-499e-40a9-bf99-9b515f6f5807 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:59.636848 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9e3dffb0-499e-40a9-bf99-9b515f6f5807 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:59.637620 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9e3dffb0-499e-40a9-bf99-9b515f6f5807 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:59.638397 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9e3dffb0-499e-40a9-bf99-9b515f6f5807 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:59.638830 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9e3dffb0-499e-40a9-bf99-9b515f6f5807 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:59.731794 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-9e3dffb0-499e-40a9-bf99-9b515f6f5807 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lazy-loading 'services' on Instance uuid 03f44195-49ec-496b-937e-eb9722a215c0 {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:47:59.939123 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9e3dffb0-499e-40a9-bf99-9b515f6f5807 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments/6d795e08-02e9-4806-8318-00afb9081e45" status: 202 len: 0 microversion: 2.20 time: 0.313450 Jul 14 11:47:59.939764 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 287/530] 10.222.0.40 () {60 vars in 1456 bytes} [Thu Jul 14 11:47:59 2022] DELETE /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments/6d795e08-02e9-4806-8318-00afb9081e45 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:47:59.948904 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-8624e27b-fdc0-45d2-9b89-2aafed17bcb8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:47:59.950172 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-8624e27b-fdc0-45d2-9b89-2aafed17bcb8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:47:59.956600 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8624e27b-fdc0-45d2-9b89-2aafed17bcb8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:59.957070 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8624e27b-fdc0-45d2-9b89-2aafed17bcb8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:59.957863 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8624e27b-fdc0-45d2-9b89-2aafed17bcb8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:47:59.958308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8624e27b-fdc0-45d2-9b89-2aafed17bcb8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:47:59.990656 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-8624e27b-fdc0-45d2-9b89-2aafed17bcb8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045648 Jul 14 11:47:59.993209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 244/531] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 11:47:59 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:48:00.348950 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c2665222-efc0-4a0e-a5e7-b6308b24b237 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:00.349597 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c2665222-efc0-4a0e-a5e7-b6308b24b237 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:00.356046 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c2665222-efc0-4a0e-a5e7-b6308b24b237 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:00.356499 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c2665222-efc0-4a0e-a5e7-b6308b24b237 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:00.357305 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c2665222-efc0-4a0e-a5e7-b6308b24b237 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:00.357746 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c2665222-efc0-4a0e-a5e7-b6308b24b237 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:00.501187 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c2665222-efc0-4a0e-a5e7-b6308b24b237 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:00.508636 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c2665222-efc0-4a0e-a5e7-b6308b24b237 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.164497 Jul 14 11:48:00.509216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 288/532] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:00 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:01.003214 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-277f5efd-fa97-4a96-aa11-6bf051b13764 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:01.004181 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-277f5efd-fa97-4a96-aa11-6bf051b13764 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:01.010941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-277f5efd-fa97-4a96-aa11-6bf051b13764 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:01.011392 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-277f5efd-fa97-4a96-aa11-6bf051b13764 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:01.012173 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-277f5efd-fa97-4a96-aa11-6bf051b13764 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:01.012608 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-277f5efd-fa97-4a96-aa11-6bf051b13764 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:01.044575 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-277f5efd-fa97-4a96-aa11-6bf051b13764 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045880 Jul 14 11:48:01.045149 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 245/533] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 11:48:00 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:48:01.525545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c6716961-eaba-4715-9525-a1b6f09f1c97 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:01.526139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c6716961-eaba-4715-9525-a1b6f09f1c97 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:01.528094 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:01.533105 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c6716961-eaba-4715-9525-a1b6f09f1c97 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:01.534145 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c6716961-eaba-4715-9525-a1b6f09f1c97 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:01.534916 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c6716961-eaba-4715-9525-a1b6f09f1c97 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:01.535343 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c6716961-eaba-4715-9525-a1b6f09f1c97 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:01.668817 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c6716961-eaba-4715-9525-a1b6f09f1c97 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:01.676732 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c6716961-eaba-4715-9525-a1b6f09f1c97 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.155361 Jul 14 11:48:01.677338 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 289/534] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:01 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:02.056190 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c6f9e7d8-277d-4953-897d-98040eaa51da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:02.057024 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c6f9e7d8-277d-4953-897d-98040eaa51da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:02.063603 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c6f9e7d8-277d-4953-897d-98040eaa51da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:02.064042 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c6f9e7d8-277d-4953-897d-98040eaa51da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:02.065332 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c6f9e7d8-277d-4953-897d-98040eaa51da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:02.065763 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c6f9e7d8-277d-4953-897d-98040eaa51da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:02.095221 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c6f9e7d8-277d-4953-897d-98040eaa51da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043126 Jul 14 11:48:02.095776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 246/535] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 11:48:02 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:48:02.694114 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-59e923a3-6d80-42af-b2dc-3898f5c824ac tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:02.695343 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-59e923a3-6d80-42af-b2dc-3898f5c824ac tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:02.702233 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-59e923a3-6d80-42af-b2dc-3898f5c824ac tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:02.702675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-59e923a3-6d80-42af-b2dc-3898f5c824ac tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:02.703480 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-59e923a3-6d80-42af-b2dc-3898f5c824ac tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:02.704489 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-59e923a3-6d80-42af-b2dc-3898f5c824ac tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:02.859973 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-59e923a3-6d80-42af-b2dc-3898f5c824ac tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:02.870882 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-59e923a3-6d80-42af-b2dc-3898f5c824ac tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.181231 Jul 14 11:48:02.872712 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 290/536] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:02 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:03.108351 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c92ff00d-bd57-457c-b7d4-9b814e0af090 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:03.109307 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c92ff00d-bd57-457c-b7d4-9b814e0af090 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:03.119332 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c92ff00d-bd57-457c-b7d4-9b814e0af090 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:03.119787 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c92ff00d-bd57-457c-b7d4-9b814e0af090 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:03.120561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c92ff00d-bd57-457c-b7d4-9b814e0af090 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:03.121292 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c92ff00d-bd57-457c-b7d4-9b814e0af090 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:03.163753 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c92ff00d-bd57-457c-b7d4-9b814e0af090 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060186 Jul 14 11:48:03.164924 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 247/537] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 11:48:03 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:48:03.889224 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-33a679dc-9ffc-4d96-bc17-227fb1c47917 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:03.889787 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-33a679dc-9ffc-4d96-bc17-227fb1c47917 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:03.891615 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:03.892453 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=6 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:03.897176 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-33a679dc-9ffc-4d96-bc17-227fb1c47917 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:03.897655 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-33a679dc-9ffc-4d96-bc17-227fb1c47917 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:03.898428 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-33a679dc-9ffc-4d96-bc17-227fb1c47917 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:03.899231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-33a679dc-9ffc-4d96-bc17-227fb1c47917 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:04.040828 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-33a679dc-9ffc-4d96-bc17-227fb1c47917 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:04.048635 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-33a679dc-9ffc-4d96-bc17-227fb1c47917 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.163360 Jul 14 11:48:04.050014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 291/538] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:03 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:04.184732 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e36893ed-3930-4255-82a1-c118d2427b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:04.185655 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e36893ed-3930-4255-82a1-c118d2427b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:04.188748 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=6 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:04.192828 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e36893ed-3930-4255-82a1-c118d2427b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:04.193337 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e36893ed-3930-4255-82a1-c118d2427b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:04.194120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e36893ed-3930-4255-82a1-c118d2427b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:04.194673 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e36893ed-3930-4255-82a1-c118d2427b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:04.231162 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e36893ed-3930-4255-82a1-c118d2427b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050935 Jul 14 11:48:04.231734 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 248/539] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 11:48:04 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:48:05.066762 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7df3ddd5-6099-42f8-9f30-eaeec402fd7d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:05.067341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7df3ddd5-6099-42f8-9f30-eaeec402fd7d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:05.073553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7df3ddd5-6099-42f8-9f30-eaeec402fd7d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:05.073996 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7df3ddd5-6099-42f8-9f30-eaeec402fd7d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:05.074765 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7df3ddd5-6099-42f8-9f30-eaeec402fd7d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:05.075191 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7df3ddd5-6099-42f8-9f30-eaeec402fd7d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:05.217368 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7df3ddd5-6099-42f8-9f30-eaeec402fd7d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:05.225812 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7df3ddd5-6099-42f8-9f30-eaeec402fd7d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.163539 Jul 14 11:48:05.226385 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 292/540] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:05 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:05.253625 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c3893ba1-7b2a-4e70-81af-753a52e4d489 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:05.258939 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c3893ba1-7b2a-4e70-81af-753a52e4d489 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:05.263907 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c3893ba1-7b2a-4e70-81af-753a52e4d489 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:05.264483 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c3893ba1-7b2a-4e70-81af-753a52e4d489 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:05.265565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c3893ba1-7b2a-4e70-81af-753a52e4d489 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:05.266023 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c3893ba1-7b2a-4e70-81af-753a52e4d489 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:05.304726 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c3893ba1-7b2a-4e70-81af-753a52e4d489 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064579 Jul 14 11:48:05.305344 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 249/541] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 11:48:05 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:48:06.242986 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-0bb5d765-26f6-43df-8753-88ab9e9f3089 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:06.243602 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-0bb5d765-26f6-43df-8753-88ab9e9f3089 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:06.249705 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0bb5d765-26f6-43df-8753-88ab9e9f3089 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:06.250120 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0bb5d765-26f6-43df-8753-88ab9e9f3089 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:06.250982 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0bb5d765-26f6-43df-8753-88ab9e9f3089 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:06.251332 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0bb5d765-26f6-43df-8753-88ab9e9f3089 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:06.315708 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-93d5f667-1036-4477-a886-3da2f930767e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:06.316634 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-93d5f667-1036-4477-a886-3da2f930767e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:06.323235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-93d5f667-1036-4477-a886-3da2f930767e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:06.323677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-93d5f667-1036-4477-a886-3da2f930767e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:06.324443 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-93d5f667-1036-4477-a886-3da2f930767e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:06.324878 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-93d5f667-1036-4477-a886-3da2f930767e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:06.329188 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=97 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:06.359005 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-93d5f667-1036-4477-a886-3da2f930767e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047257 Jul 14 11:48:06.364719 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 250/542] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 11:48:06 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 11:48:06.388921 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-0bb5d765-26f6-43df-8753-88ab9e9f3089 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:06.396917 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-0bb5d765-26f6-43df-8753-88ab9e9f3089 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.157719 Jul 14 11:48:06.397532 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 293/543] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:06 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:07.371466 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-48a52cfc-7068-40ec-8e7e-0e44e5ddbaa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:07.372623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-48a52cfc-7068-40ec-8e7e-0e44e5ddbaa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:07.374950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:07.380520 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-48a52cfc-7068-40ec-8e7e-0e44e5ddbaa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:07.380970 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-48a52cfc-7068-40ec-8e7e-0e44e5ddbaa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:07.381767 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-48a52cfc-7068-40ec-8e7e-0e44e5ddbaa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:07.382198 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-48a52cfc-7068-40ec-8e7e-0e44e5ddbaa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:07.415048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-de14bc05-8ee5-4817-b180-383f01594224 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:07.415684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-de14bc05-8ee5-4817-b180-383f01594224 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:07.418839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-48a52cfc-7068-40ec-8e7e-0e44e5ddbaa4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051805 Jul 14 11:48:07.419463 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 251/544] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 11:48:07 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:48:07.422477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-de14bc05-8ee5-4817-b180-383f01594224 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:07.422929 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-de14bc05-8ee5-4817-b180-383f01594224 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:07.425801 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-de14bc05-8ee5-4817-b180-383f01594224 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:07.426280 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-de14bc05-8ee5-4817-b180-383f01594224 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:07.589094 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-de14bc05-8ee5-4817-b180-383f01594224 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:07.597321 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-de14bc05-8ee5-4817-b180-383f01594224 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.187085 Jul 14 11:48:07.598091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 294/545] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:07 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:07.730808 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-632dcf15-681a-4703-9882-b83c6a1d1d64 req-0b667a5b-f7ee-48ca-96ac-9d1999509bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88440aae-c9af-4f69-bdae-38f9d81c06a7", "tag": "f79bdd51-95b5-4720-a060-677fe13019be"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:07.741287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-632dcf15-681a-4703-9882-b83c6a1d1d64 req-0b667a5b-f7ee-48ca-96ac-9d1999509bfa service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:07.741984 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-632dcf15-681a-4703-9882-b83c6a1d1d64 req-0b667a5b-f7ee-48ca-96ac-9d1999509bfa service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:07.755163 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-632dcf15-681a-4703-9882-b83c6a1d1d64 req-0b667a5b-f7ee-48ca-96ac-9d1999509bfa service nova] Creating event network-changed:f79bdd51-95b5-4720-a060-677fe13019be for instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 on hv-cinder-84980 Jul 14 11:48:07.760569 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-632dcf15-681a-4703-9882-b83c6a1d1d64 req-0b667a5b-f7ee-48ca-96ac-9d1999509bfa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038038 Jul 14 11:48:07.761215 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 252/546] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:08.431424 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-83385688-6ce5-4b7a-a5ef-7d01db453993 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:08.432349 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-83385688-6ce5-4b7a-a5ef-7d01db453993 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:08.438619 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-83385688-6ce5-4b7a-a5ef-7d01db453993 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:08.439066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-83385688-6ce5-4b7a-a5ef-7d01db453993 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:08.439840 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-83385688-6ce5-4b7a-a5ef-7d01db453993 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:08.440367 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-83385688-6ce5-4b7a-a5ef-7d01db453993 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:08.444029 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:08.468721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-83385688-6ce5-4b7a-a5ef-7d01db453993 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042058 Jul 14 11:48:08.469301 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 295/547] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 11:48:08 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:08.527328 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3af12062-1157-477c-a61c-9a8f25f731a3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:08.527919 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3af12062-1157-477c-a61c-9a8f25f731a3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:08.534273 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3af12062-1157-477c-a61c-9a8f25f731a3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:08.534730 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3af12062-1157-477c-a61c-9a8f25f731a3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:08.535517 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3af12062-1157-477c-a61c-9a8f25f731a3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:08.536461 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3af12062-1157-477c-a61c-9a8f25f731a3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:08.560959 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3af12062-1157-477c-a61c-9a8f25f731a3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Going to try to terminate instance {{(pid=124946) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:48:08.615290 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-76e434ca-e80e-4d46-b2e0-6b20f20659af tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:08.615889 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-76e434ca-e80e-4d46-b2e0-6b20f20659af tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:08.622269 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-76e434ca-e80e-4d46-b2e0-6b20f20659af tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:08.622711 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-76e434ca-e80e-4d46-b2e0-6b20f20659af tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:08.623463 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-76e434ca-e80e-4d46-b2e0-6b20f20659af tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:08.623895 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-76e434ca-e80e-4d46-b2e0-6b20f20659af tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:08.759589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-76e434ca-e80e-4d46-b2e0-6b20f20659af tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:08.766021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-76e434ca-e80e-4d46-b2e0-6b20f20659af tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.155473 Jul 14 11:48:08.766605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 296/548] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:08 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:08.819039 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3af12062-1157-477c-a61c-9a8f25f731a3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 204 len: 0 microversion: 2.20 time: 0.296757 Jul 14 11:48:08.819644 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 253/549] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jul 14 11:48:08 2022] DELETE /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 11:48:08.827979 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b7bf894f-da5f-4025-81d4-c2e5ca248be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:08.834100 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b7bf894f-da5f-4025-81d4-c2e5ca248be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:08.835405 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b7bf894f-da5f-4025-81d4-c2e5ca248be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:08.835838 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b7bf894f-da5f-4025-81d4-c2e5ca248be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:08.836604 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b7bf894f-da5f-4025-81d4-c2e5ca248be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:08.837039 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b7bf894f-da5f-4025-81d4-c2e5ca248be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:08.966302 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b7bf894f-da5f-4025-81d4-c2e5ca248be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:08.974863 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b7bf894f-da5f-4025-81d4-c2e5ca248be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:08.976447 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b7bf894f-da5f-4025-81d4-c2e5ca248be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:08.977625 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b7bf894f-da5f-4025-81d4-c2e5ca248be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.153592 Jul 14 11:48:08.978175 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 297/550] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:08 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:48:09.788099 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-fa5f35ff-f454-43ff-8fac-58ed31a89061 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:09.788805 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-fa5f35ff-f454-43ff-8fac-58ed31a89061 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:09.795356 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fa5f35ff-f454-43ff-8fac-58ed31a89061 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:09.795808 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fa5f35ff-f454-43ff-8fac-58ed31a89061 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:09.796582 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fa5f35ff-f454-43ff-8fac-58ed31a89061 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:09.797031 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fa5f35ff-f454-43ff-8fac-58ed31a89061 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:09.930208 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-fa5f35ff-f454-43ff-8fac-58ed31a89061 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:09.937590 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-fa5f35ff-f454-43ff-8fac-58ed31a89061 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.153892 Jul 14 11:48:09.938157 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 254/551] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:09 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:09.996375 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7e71af4a-1e1b-4720-9d1c-1bc9b2226f21 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:09.997017 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7e71af4a-1e1b-4720-9d1c-1bc9b2226f21 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:10.003301 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7e71af4a-1e1b-4720-9d1c-1bc9b2226f21 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:10.003751 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7e71af4a-1e1b-4720-9d1c-1bc9b2226f21 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:10.004520 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7e71af4a-1e1b-4720-9d1c-1bc9b2226f21 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:10.004957 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7e71af4a-1e1b-4720-9d1c-1bc9b2226f21 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:10.136732 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7e71af4a-1e1b-4720-9d1c-1bc9b2226f21 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:10.144792 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7e71af4a-1e1b-4720-9d1c-1bc9b2226f21 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:10.146361 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7e71af4a-1e1b-4720-9d1c-1bc9b2226f21 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:10.147515 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7e71af4a-1e1b-4720-9d1c-1bc9b2226f21 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.155121 Jul 14 11:48:10.148285 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 298/552] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:09 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:48:11.020998 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-2ebb839e-7511-4699-8b31-c42859a7806f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:11.020998 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-2ebb839e-7511-4699-8b31-c42859a7806f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:11.020998 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2ebb839e-7511-4699-8b31-c42859a7806f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:11.020998 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2ebb839e-7511-4699-8b31-c42859a7806f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:11.022017 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2ebb839e-7511-4699-8b31-c42859a7806f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:11.022017 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2ebb839e-7511-4699-8b31-c42859a7806f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:11.166517 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b2816f98-371d-4583-aee4-a0fbd3716af2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:11.167860 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b2816f98-371d-4583-aee4-a0fbd3716af2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:11.175501 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2816f98-371d-4583-aee4-a0fbd3716af2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:11.176048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2816f98-371d-4583-aee4-a0fbd3716af2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:11.177567 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2816f98-371d-4583-aee4-a0fbd3716af2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:11.178080 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2816f98-371d-4583-aee4-a0fbd3716af2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:11.192428 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-2ebb839e-7511-4699-8b31-c42859a7806f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:11.198742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-2ebb839e-7511-4699-8b31-c42859a7806f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.248443 Jul 14 11:48:11.199652 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 255/553] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:10 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:11.694591 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b2816f98-371d-4583-aee4-a0fbd3716af2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:11.702893 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b2816f98-371d-4583-aee4-a0fbd3716af2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:11.704538 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b2816f98-371d-4583-aee4-a0fbd3716af2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:11.705930 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b2816f98-371d-4583-aee4-a0fbd3716af2 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1724 microversion: 2.20 time: 0.543373 Jul 14 11:48:11.706498 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 299/554] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:11 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1724 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:48:12.218164 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-78b28fc3-6d34-42e3-941c-2072f3086239 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:12.219557 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-78b28fc3-6d34-42e3-941c-2072f3086239 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:12.228796 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-78b28fc3-6d34-42e3-941c-2072f3086239 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:12.229270 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-78b28fc3-6d34-42e3-941c-2072f3086239 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:12.230041 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-78b28fc3-6d34-42e3-941c-2072f3086239 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:12.230471 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-78b28fc3-6d34-42e3-941c-2072f3086239 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:12.263222 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-4a5515bd-db67-431f-8271-e6ed0e19cd2b req-91985db0-6fe7-4f24-bd60-aa55c389b19e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f44195-49ec-496b-937e-eb9722a215c0", "name": "network-vif-deleted", "tag": "cf1c50ae-e6c8-42f3-9333-a8eaf141bcd0"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:12.272256 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-4a5515bd-db67-431f-8271-e6ed0e19cd2b req-91985db0-6fe7-4f24-bd60-aa55c389b19e service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:12.280802 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-4a5515bd-db67-431f-8271-e6ed0e19cd2b req-91985db0-6fe7-4f24-bd60-aa55c389b19e service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:12.288977 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-4a5515bd-db67-431f-8271-e6ed0e19cd2b req-91985db0-6fe7-4f24-bd60-aa55c389b19e service nova] Creating event network-vif-deleted:cf1c50ae-e6c8-42f3-9333-a8eaf141bcd0 for instance 03f44195-49ec-496b-937e-eb9722a215c0 on hv-cinder-84980 Jul 14 11:48:12.294613 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-4a5515bd-db67-431f-8271-e6ed0e19cd2b req-91985db0-6fe7-4f24-bd60-aa55c389b19e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043455 Jul 14 11:48:12.295619 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 300/555] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:12.385042 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-78b28fc3-6d34-42e3-941c-2072f3086239 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:12.394785 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-78b28fc3-6d34-42e3-941c-2072f3086239 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.181259 Jul 14 11:48:12.394785 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 256/556] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:12 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:12.725719 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-384a47ad-e3c4-4157-b644-4923dc16c7e0 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:12.726439 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-384a47ad-e3c4-4157-b644-4923dc16c7e0 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:12.732851 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-384a47ad-e3c4-4157-b644-4923dc16c7e0 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:12.733406 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-384a47ad-e3c4-4157-b644-4923dc16c7e0 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:12.734259 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-384a47ad-e3c4-4157-b644-4923dc16c7e0 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:12.734751 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-384a47ad-e3c4-4157-b644-4923dc16c7e0 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:12.766091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-384a47ad-e3c4-4157-b644-4923dc16c7e0 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:12.766551 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-384a47ad-e3c4-4157-b644-4923dc16c7e0 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:12.766972 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-384a47ad-e3c4-4157-b644-4923dc16c7e0 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lazy-loading 'fault' on Instance uuid 03f44195-49ec-496b-937e-eb9722a215c0 {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:48:12.814768 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-384a47ad-e3c4-4157-b644-4923dc16c7e0 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:12.822905 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-384a47ad-e3c4-4157-b644-4923dc16c7e0 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:12.824507 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-384a47ad-e3c4-4157-b644-4923dc16c7e0 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:12.825777 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-384a47ad-e3c4-4157-b644-4923dc16c7e0 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 200 len: 1371 microversion: 2.20 time: 0.105116 Jul 14 11:48:12.826415 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 301/557] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:12 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:48:13.106750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-1c742b07-5cfc-436f-b7a0-0904d38c02e1 req-dd5ed8e8-1de7-422d-bdca-e002561a5d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88440aae-c9af-4f69-bdae-38f9d81c06a7", "name": "network-vif-plugged", "status": "completed", "tag": "f79bdd51-95b5-4720-a060-677fe13019be"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:13.118630 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-1c742b07-5cfc-436f-b7a0-0904d38c02e1 req-dd5ed8e8-1de7-422d-bdca-e002561a5d43 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:13.119161 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-1c742b07-5cfc-436f-b7a0-0904d38c02e1 req-dd5ed8e8-1de7-422d-bdca-e002561a5d43 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:13.131975 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-1c742b07-5cfc-436f-b7a0-0904d38c02e1 req-dd5ed8e8-1de7-422d-bdca-e002561a5d43 service nova] Creating event network-vif-plugged:f79bdd51-95b5-4720-a060-677fe13019be for instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 on hv-cinder-84980 Jul 14 11:48:13.137671 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-1c742b07-5cfc-436f-b7a0-0904d38c02e1 req-dd5ed8e8-1de7-422d-bdca-e002561a5d43 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036270 Jul 14 11:48:13.138322 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 257/558] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:13.410519 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-4bad400f-ed56-4536-9be6-ed0afc7aedd8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:13.411246 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-4bad400f-ed56-4536-9be6-ed0afc7aedd8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:13.417396 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4bad400f-ed56-4536-9be6-ed0afc7aedd8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:13.417846 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4bad400f-ed56-4536-9be6-ed0afc7aedd8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:13.418615 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4bad400f-ed56-4536-9be6-ed0afc7aedd8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:13.419047 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4bad400f-ed56-4536-9be6-ed0afc7aedd8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:13.600620 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-4bad400f-ed56-4536-9be6-ed0afc7aedd8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:13.608008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-4bad400f-ed56-4536-9be6-ed0afc7aedd8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.201384 Jul 14 11:48:13.608570 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 302/559] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:13 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:13.845444 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-331742dc-c9c3-402a-90cd-e0385096c274 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:13.846136 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-331742dc-c9c3-402a-90cd-e0385096c274 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:13.852910 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-331742dc-c9c3-402a-90cd-e0385096c274 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:13.853386 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-331742dc-c9c3-402a-90cd-e0385096c274 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:13.854139 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-331742dc-c9c3-402a-90cd-e0385096c274 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:13.854572 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-331742dc-c9c3-402a-90cd-e0385096c274 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:13.868258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-331742dc-c9c3-402a-90cd-e0385096c274 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] HTTP exception thrown: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-331742dc-c9c3-402a-90cd-e0385096c274 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Request method failure captured: Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 HTTP/1.1 Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGMSn7vQegOUWmSGgr_EOwUboZjvtuC0z2ZIkI74vrcApT1meUEh0Vm2NexV6jNnwhFR25jj32KjYlT0TcKdhtN8PZJAKqHjUiNEGHQfuvToxMYoOH28RYTOr5HgE_PdImIc_-bsBaF1kyOpLe_k8NBL4OqUd_t3VZ6Yz_FbzY6BNI Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 81777430895b432999f69033667e59f1 Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:48:13.869920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:48:13.871545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81777430895b432999f69033667e59f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81777430895b432999f69033667e59f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81777430895b432999f69033667e59f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81777430895b432999f69033667e59f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:48:13.871545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:48:13.871545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 81777430895b432999f69033667e59f1 Jul 14 11:48:13.871545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:48:13.871545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-AttachVolumeShelveTestJSON-2001742360-project Jul 14 11:48:13.871545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:48:13.871545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:48:13.871545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 899cbac79d874b308b500651bb40b2a7 Jul 14 11:48:13.871545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2001742360-project Jul 14 11:48:13.871545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:48:13.871545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. Jul 14 11:48:13.871545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '03f44195-49ec-496b-937e-eb9722a215c0'} Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:48:13.873300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. Jul 14 11:48:13.874822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:13.876078 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-331742dc-c9c3-402a-90cd-e0385096c274 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Returning 404 to user: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:48:13.876078 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-331742dc-c9c3-402a-90cd-e0385096c274 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 404 len: 111 microversion: 2.20 time: 0.030623 Jul 14 11:48:13.876078 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 258/560] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:13 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:48:13.880294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9178e926-5e63-4c3c-b626-37f5fd906066 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '.version_select at 0x7f1adf683940>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:13.986188 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9178e926-5e63-4c3c-b626-37f5fd906066 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480488436" status: 204 len: 0 microversion: 2.20 time: 0.109636 Jul 14 11:48:13.986788 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 303/561] 10.222.0.40 () {60 vars in 1261 bytes} [Thu Jul 14 11:48:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480488436 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 11:48:14.625236 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4c663728-11ac-4576-895a-1d00754ce7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:14.625797 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-4c663728-11ac-4576-895a-1d00754ce7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:14.633558 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4c663728-11ac-4576-895a-1d00754ce7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:14.634010 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4c663728-11ac-4576-895a-1d00754ce7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:14.634794 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4c663728-11ac-4576-895a-1d00754ce7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:14.635226 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4c663728-11ac-4576-895a-1d00754ce7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:14.833349 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-4c663728-11ac-4576-895a-1d00754ce7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:14.842693 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-4c663728-11ac-4576-895a-1d00754ce7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1357 microversion: 2.1 time: 0.221369 Jul 14 11:48:14.843330 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 259/562] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:14 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:15.132728 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-816db85c-90d0-46f5-abb8-68a825a6acf9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Action: 'create', calling method: .version_select at 0x7f1adf783d30>, body: {"keypair": {"name": "tempest-keypair-1891798121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRha3k9/VwOTH1GNtKy2qzzg/mlCT75HnYE0cdQxDhhW2KzXnhVib95yRBYxFPsElTkQ5pB0ewCHg+lx2SFv/pOpPxWOCprw9YoeGdnw/3gIcBEjl7oiA3EgiiVKC1SHw=="}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:15.147921 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-816db85c-90d0-46f5-abb8-68a825a6acf9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Getting quotas for project 81777430895b432999f69033667e59f1. Resources: {'key_pairs'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:48:15.152782 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-816db85c-90d0-46f5-abb8-68a825a6acf9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Getting quotas for user 899cbac79d874b308b500651bb40b2a7 and project 81777430895b432999f69033667e59f1. Resources: {'key_pairs'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:48:15.278046 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-816db85c-90d0-46f5-abb8-68a825a6acf9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.149450 Jul 14 11:48:15.278649 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 304/563] 10.222.0.40 () {62 vars in 1199 bytes} [Thu Jul 14 11:48:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 11:48:15.859965 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-172d2275-92bb-4a7d-a4c1-b95dc51c3848 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:15.860424 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-172d2275-92bb-4a7d-a4c1-b95dc51c3848 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:15.867275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-172d2275-92bb-4a7d-a4c1-b95dc51c3848 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:15.867730 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-172d2275-92bb-4a7d-a4c1-b95dc51c3848 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:15.869552 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-172d2275-92bb-4a7d-a4c1-b95dc51c3848 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:15.870004 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-172d2275-92bb-4a7d-a4c1-b95dc51c3848 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:16.045491 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-172d2275-92bb-4a7d-a4c1-b95dc51c3848 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:16.053446 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-172d2275-92bb-4a7d-a4c1-b95dc51c3848 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1547 microversion: 2.1 time: 0.197987 Jul 14 11:48:16.054884 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 260/564] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:15 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1547 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:16.070426 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-86da10bd-0008-4bd7-894c-2cfb7856c207 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:16.074739 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-86da10bd-0008-4bd7-894c-2cfb7856c207 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:16.078300 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-86da10bd-0008-4bd7-894c-2cfb7856c207 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:16.079089 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-86da10bd-0008-4bd7-894c-2cfb7856c207 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:16.079879 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-86da10bd-0008-4bd7-894c-2cfb7856c207 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:16.080322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-86da10bd-0008-4bd7-894c-2cfb7856c207 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:16.212788 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-86da10bd-0008-4bd7-894c-2cfb7856c207 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:16.220886 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-86da10bd-0008-4bd7-894c-2cfb7856c207 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1547 microversion: 2.1 time: 0.155560 Jul 14 11:48:16.221720 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 305/565] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:16 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:16.236623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3646fb45-1090-4c9f-b326-a6b8169708c8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:16.240162 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-3646fb45-1090-4c9f-b326-a6b8169708c8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:16.241540 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3646fb45-1090-4c9f-b326-a6b8169708c8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Searching by: {'deleted': False, 'project_id': 'dc22323158714269b0da2b01121fe3ed'} {{(pid=124946) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 11:48:16.248384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3646fb45-1090-4c9f-b326-a6b8169708c8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:16.248827 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3646fb45-1090-4c9f-b326-a6b8169708c8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:16.249655 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3646fb45-1090-4c9f-b326-a6b8169708c8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:16.250088 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3646fb45-1090-4c9f-b326-a6b8169708c8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:16.342347 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.multi_cell_list [None req-3646fb45-1090-4c9f-b326-a6b8169708c8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124946) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 11:48:16.436422 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3646fb45-1090-4c9f-b326-a6b8169708c8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203646 Jul 14 11:48:16.437015 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 261/566] 10.222.0.40 () {58 vars in 1124 bytes} [Thu Jul 14 11:48:16 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:16.447764 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-e82af359-34e9-471e-8b11-e9531cc0c317 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:16.448471 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-e82af359-34e9-471e-8b11-e9531cc0c317 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:16.455039 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e82af359-34e9-471e-8b11-e9531cc0c317 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:16.455564 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e82af359-34e9-471e-8b11-e9531cc0c317 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:16.456403 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e82af359-34e9-471e-8b11-e9531cc0c317 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:16.456936 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e82af359-34e9-471e-8b11-e9531cc0c317 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:16.594537 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e82af359-34e9-471e-8b11-e9531cc0c317 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:16.602793 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-e82af359-34e9-471e-8b11-e9531cc0c317 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1547 microversion: 2.1 time: 0.159531 Jul 14 11:48:16.603445 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 306/567] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:16 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:17.541203 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-590123036", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4586847-6136-4dce-945a-818d63fc4328"}], "security_groups": [{"name": "tempest-securitygroup--1161968899"}], "key_name": "tempest-keypair-1891798121", "user_data": "}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:17.645770 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.network.neutron [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] validate_networks() for [('e4586847-6136-4dce-945a-818d63fc4328', None, None, None, None, None)] {{(pid=124946) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:48:18.011635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Flavor limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:48:18.012056 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Image limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:48:18.012521 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Flavor pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:48:18.012924 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Image pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:48:18.013376 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:48:18.022931 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:18.024119 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:18.024426 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:18.024863 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:18.042142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Getting quotas for project 81777430895b432999f69033667e59f1. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:48:18.046108 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Getting quotas for user 899cbac79d874b308b500651bb40b2a7 and project 81777430895b432999f69033667e59f1. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:48:18.057005 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Going to run 1 instances... {{(pid=124946) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:48:18.059292 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124946) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:48:18.158840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-be8fdba7-025c-4060-9e47-e278573b893b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.622646 Jul 14 11:48:18.159766 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 262/568] 10.222.0.40 () {62 vars in 1187 bytes} [Thu Jul 14 11:48:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 11:48:18.169789 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-eb292743-1d47-4b33-bb6b-35aaa834bb39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:18.170416 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-eb292743-1d47-4b33-bb6b-35aaa834bb39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:18.228601 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-eb292743-1d47-4b33-bb6b-35aaa834bb39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:18.236531 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-eb292743-1d47-4b33-bb6b-35aaa834bb39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:18.238115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-eb292743-1d47-4b33-bb6b-35aaa834bb39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:18.239309 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-eb292743-1d47-4b33-bb6b-35aaa834bb39 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1281 microversion: 2.20 time: 0.073415 Jul 14 11:48:18.239883 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 307/569] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:18 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:48:18.556317 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-23f9e098-e41e-4ac5-aaa2-535ca13291e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40c4da5d-6fda-434f-bcc3-c00257402c06"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:18.557412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-23f9e098-e41e-4ac5-aaa2-535ca13291e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:18.563994 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-23f9e098-e41e-4ac5-aaa2-535ca13291e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:18.570252 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-23f9e098-e41e-4ac5-aaa2-535ca13291e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:18.570252 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-23f9e098-e41e-4ac5-aaa2-535ca13291e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:18.570252 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-23f9e098-e41e-4ac5-aaa2-535ca13291e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:19.257904 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d27aa5d8-a42b-4e84-b8f7-feee624aab38 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:19.258522 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d27aa5d8-a42b-4e84-b8f7-feee624aab38 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:19.262921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-23f9e098-e41e-4ac5-aaa2-535ca13291e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "POST /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.711465 Jul 14 11:48:19.263730 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 263/570] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 11:48:18 2022] POST /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments => generated 194 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:19.266223 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d27aa5d8-a42b-4e84-b8f7-feee624aab38 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:19.266796 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d27aa5d8-a42b-4e84-b8f7-feee624aab38 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:19.276397 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d27aa5d8-a42b-4e84-b8f7-feee624aab38 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:19.276397 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d27aa5d8-a42b-4e84-b8f7-feee624aab38 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:19.332779 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d27aa5d8-a42b-4e84-b8f7-feee624aab38 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:19.341889 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d27aa5d8-a42b-4e84-b8f7-feee624aab38 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:19.343425 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d27aa5d8-a42b-4e84-b8f7-feee624aab38 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:19.344534 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d27aa5d8-a42b-4e84-b8f7-feee624aab38 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1285 microversion: 2.20 time: 0.090977 Jul 14 11:48:19.345864 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 308/571] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:19 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:48:20.365419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-0ba55c76-ffbb-4bd1-844a-f4995e85a6ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:20.366658 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-0ba55c76-ffbb-4bd1-844a-f4995e85a6ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:20.379174 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0ba55c76-ffbb-4bd1-844a-f4995e85a6ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:20.379415 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0ba55c76-ffbb-4bd1-844a-f4995e85a6ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:20.380203 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0ba55c76-ffbb-4bd1-844a-f4995e85a6ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:20.380647 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0ba55c76-ffbb-4bd1-844a-f4995e85a6ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:20.452441 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-0ba55c76-ffbb-4bd1-844a-f4995e85a6ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:20.460743 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-0ba55c76-ffbb-4bd1-844a-f4995e85a6ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:20.462448 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-0ba55c76-ffbb-4bd1-844a-f4995e85a6ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:20.463578 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-0ba55c76-ffbb-4bd1-844a-f4995e85a6ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1351 microversion: 2.20 time: 0.102374 Jul 14 11:48:20.464132 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 264/572] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:20 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:48:21.486523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2887468c-a3d6-498d-8ada-acfee40b563c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:21.487130 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2887468c-a3d6-498d-8ada-acfee40b563c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:21.493521 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2887468c-a3d6-498d-8ada-acfee40b563c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:21.493871 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2887468c-a3d6-498d-8ada-acfee40b563c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:21.494640 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2887468c-a3d6-498d-8ada-acfee40b563c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:21.495074 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2887468c-a3d6-498d-8ada-acfee40b563c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:21.713549 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2887468c-a3d6-498d-8ada-acfee40b563c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:21.722060 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2887468c-a3d6-498d-8ada-acfee40b563c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:21.723578 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2887468c-a3d6-498d-8ada-acfee40b563c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:21.725303 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2887468c-a3d6-498d-8ada-acfee40b563c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1407 microversion: 2.20 time: 0.242401 Jul 14 11:48:21.725733 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 309/573] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:21 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:48:21.944166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-c1b64eae-f852-429b-a562-4ce109c96c53 req-1da5c621-cf2c-4f2e-bc43-4e814349485f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e08c817f-cc75-4c71-8645-51a7a1938404", "tag": "5c8aa46b-5efe-4ab3-b31e-03775de21303"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:21.956515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-c1b64eae-f852-429b-a562-4ce109c96c53 req-1da5c621-cf2c-4f2e-bc43-4e814349485f service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:21.956515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-c1b64eae-f852-429b-a562-4ce109c96c53 req-1da5c621-cf2c-4f2e-bc43-4e814349485f service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:21.967740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-c1b64eae-f852-429b-a562-4ce109c96c53 req-1da5c621-cf2c-4f2e-bc43-4e814349485f service nova] Creating event network-changed:5c8aa46b-5efe-4ab3-b31e-03775de21303 for instance e08c817f-cc75-4c71-8645-51a7a1938404 on hv-cinder-84980 Jul 14 11:48:21.973135 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-c1b64eae-f852-429b-a562-4ce109c96c53 req-1da5c621-cf2c-4f2e-bc43-4e814349485f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032587 Jul 14 11:48:21.973964 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 265/574] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:22.743976 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1bbbf37f-580f-4590-91d4-b833274bf7cb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:22.744526 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1bbbf37f-580f-4590-91d4-b833274bf7cb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:22.750675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1bbbf37f-580f-4590-91d4-b833274bf7cb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:22.751137 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1bbbf37f-580f-4590-91d4-b833274bf7cb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:22.751891 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1bbbf37f-580f-4590-91d4-b833274bf7cb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:22.752319 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1bbbf37f-580f-4590-91d4-b833274bf7cb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:22.893466 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1bbbf37f-580f-4590-91d4-b833274bf7cb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:22.902313 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1bbbf37f-580f-4590-91d4-b833274bf7cb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:22.903846 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1bbbf37f-580f-4590-91d4-b833274bf7cb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:22.904938 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1bbbf37f-580f-4590-91d4-b833274bf7cb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1407 microversion: 2.20 time: 0.164981 Jul 14 11:48:22.905556 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 310/575] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:22 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:48:23.923790 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-629de086-38e7-45d1-a087-6cab0f54c4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:23.924481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-629de086-38e7-45d1-a087-6cab0f54c4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:23.930803 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-629de086-38e7-45d1-a087-6cab0f54c4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:23.931244 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-629de086-38e7-45d1-a087-6cab0f54c4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:23.932002 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-629de086-38e7-45d1-a087-6cab0f54c4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:23.932435 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-629de086-38e7-45d1-a087-6cab0f54c4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:24.064573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-629de086-38e7-45d1-a087-6cab0f54c4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:24.072043 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:24.073868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-629de086-38e7-45d1-a087-6cab0f54c4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:24.075386 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-629de086-38e7-45d1-a087-6cab0f54c4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:24.076497 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-629de086-38e7-45d1-a087-6cab0f54c4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1407 microversion: 2.20 time: 0.157480 Jul 14 11:48:24.077060 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 266/576] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:23 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:48:24.549081 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8ca2266a-be5e-41b2-aefe-a8dfb68dfa5d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cc33005-cf36-4ae0-acff-c1f8069a90b7"}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:24.550229 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-8ca2266a-be5e-41b2-aefe-a8dfb68dfa5d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:24.556251 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8ca2266a-be5e-41b2-aefe-a8dfb68dfa5d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:24.556698 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8ca2266a-be5e-41b2-aefe-a8dfb68dfa5d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:24.557482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8ca2266a-be5e-41b2-aefe-a8dfb68dfa5d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:24.557908 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8ca2266a-be5e-41b2-aefe-a8dfb68dfa5d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:25.094842 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-909d40a3-4309-4fc0-bcf3-34207bcda1af tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:25.095451 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-909d40a3-4309-4fc0-bcf3-34207bcda1af tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:25.102595 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-909d40a3-4309-4fc0-bcf3-34207bcda1af tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:25.107513 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-909d40a3-4309-4fc0-bcf3-34207bcda1af tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:25.107513 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-909d40a3-4309-4fc0-bcf3-34207bcda1af tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:25.107513 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-909d40a3-4309-4fc0-bcf3-34207bcda1af tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:25.239101 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-909d40a3-4309-4fc0-bcf3-34207bcda1af tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:25.244454 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-909d40a3-4309-4fc0-bcf3-34207bcda1af tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:25.246051 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-909d40a3-4309-4fc0-bcf3-34207bcda1af tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:25.247160 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-909d40a3-4309-4fc0-bcf3-34207bcda1af tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1407 microversion: 2.20 time: 0.156248 Jul 14 11:48:25.247724 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 267/577] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:25 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:48:25.452264 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-8ca2266a-be5e-41b2-aefe-a8dfb68dfa5d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "POST /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.906883 Jul 14 11:48:25.452791 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 311/578] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 11:48:24 2022] POST /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments => generated 194 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:26.265530 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-0d38fd3f-b8e4-4ea8-9c15-c357839da9ba tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:26.266195 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-0d38fd3f-b8e4-4ea8-9c15-c357839da9ba tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:26.272818 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0d38fd3f-b8e4-4ea8-9c15-c357839da9ba tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:26.273305 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0d38fd3f-b8e4-4ea8-9c15-c357839da9ba tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:26.274397 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0d38fd3f-b8e4-4ea8-9c15-c357839da9ba tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:26.274838 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0d38fd3f-b8e4-4ea8-9c15-c357839da9ba tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:26.410439 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-0d38fd3f-b8e4-4ea8-9c15-c357839da9ba tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:26.420493 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-0d38fd3f-b8e4-4ea8-9c15-c357839da9ba tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:26.422263 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-0d38fd3f-b8e4-4ea8-9c15-c357839da9ba tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:26.423488 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-0d38fd3f-b8e4-4ea8-9c15-c357839da9ba tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1407 microversion: 2.20 time: 0.162189 Jul 14 11:48:26.424322 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 268/579] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:26 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:48:26.846576 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f4c6311b-2ef1-442f-90c2-accacfbe0b3d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:26.847360 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f4c6311b-2ef1-442f-90c2-accacfbe0b3d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:26.855041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f4c6311b-2ef1-442f-90c2-accacfbe0b3d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:26.855425 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f4c6311b-2ef1-442f-90c2-accacfbe0b3d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:26.856192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f4c6311b-2ef1-442f-90c2-accacfbe0b3d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:26.856728 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f4c6311b-2ef1-442f-90c2-accacfbe0b3d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:26.896143 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-70bd14aa-028a-47b5-8f5c-ae343ff7c0ac tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:26.899011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-70bd14aa-028a-47b5-8f5c-ae343ff7c0ac tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:26.912254 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-70bd14aa-028a-47b5-8f5c-ae343ff7c0ac tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:26.913818 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-70bd14aa-028a-47b5-8f5c-ae343ff7c0ac tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:26.920466 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-70bd14aa-028a-47b5-8f5c-ae343ff7c0ac tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:26.920466 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-70bd14aa-028a-47b5-8f5c-ae343ff7c0ac tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:26.950043 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-70bd14aa-028a-47b5-8f5c-ae343ff7c0ac tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059117 Jul 14 11:48:26.950616 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 269/580] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:48:26 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:48:26.998423 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f4c6311b-2ef1-442f-90c2-accacfbe0b3d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:27.006769 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f4c6311b-2ef1-442f-90c2-accacfbe0b3d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1593 microversion: 2.1 time: 0.167325 Jul 14 11:48:27.007341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 312/581] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:26 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1593 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:27.010347 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-93edfbc7-bfdc-4811-a196-1fd838da60d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:27.010838 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-93edfbc7-bfdc-4811-a196-1fd838da60d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:27.017505 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-93edfbc7-bfdc-4811-a196-1fd838da60d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:27.018239 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-93edfbc7-bfdc-4811-a196-1fd838da60d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:27.019284 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-93edfbc7-bfdc-4811-a196-1fd838da60d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:27.019855 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-93edfbc7-bfdc-4811-a196-1fd838da60d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:27.053705 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-93edfbc7-bfdc-4811-a196-1fd838da60d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Going to try to terminate instance {{(pid=124946) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:48:27.130648 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-fd1e5ba0-6018-4125-a150-5eca19db309b req-3ceab042-34a2-4246-9d15-748f3005db59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08c817f-cc75-4c71-8645-51a7a1938404", "name": "network-vif-plugged", "status": "completed", "tag": "5c8aa46b-5efe-4ab3-b31e-03775de21303"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:27.139613 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-fd1e5ba0-6018-4125-a150-5eca19db309b req-3ceab042-34a2-4246-9d15-748f3005db59 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:27.140195 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-fd1e5ba0-6018-4125-a150-5eca19db309b req-3ceab042-34a2-4246-9d15-748f3005db59 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:27.152444 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-fd1e5ba0-6018-4125-a150-5eca19db309b req-3ceab042-34a2-4246-9d15-748f3005db59 service nova] Creating event network-vif-plugged:5c8aa46b-5efe-4ab3-b31e-03775de21303 for instance e08c817f-cc75-4c71-8645-51a7a1938404 on hv-cinder-84980 Jul 14 11:48:27.157772 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-fd1e5ba0-6018-4125-a150-5eca19db309b req-3ceab042-34a2-4246-9d15-748f3005db59 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030801 Jul 14 11:48:27.158365 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 313/582] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:48:27.420392 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-93edfbc7-bfdc-4811-a196-1fd838da60d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "DELETE /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 204 len: 0 microversion: 2.1 time: 0.413687 Jul 14 11:48:27.421192 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 270/583] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:48:27 2022] DELETE /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:48:27.429891 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b4a3e507-739c-4d2d-9b06-4f080053a577 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:27.430587 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b4a3e507-739c-4d2d-9b06-4f080053a577 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:27.442405 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-926320a9-3d1e-4e08-a6dd-0a35d0cbdf6a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:27.443099 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-926320a9-3d1e-4e08-a6dd-0a35d0cbdf6a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:27.443771 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b4a3e507-739c-4d2d-9b06-4f080053a577 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:27.444413 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b4a3e507-739c-4d2d-9b06-4f080053a577 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:27.445246 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b4a3e507-739c-4d2d-9b06-4f080053a577 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:27.445831 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b4a3e507-739c-4d2d-9b06-4f080053a577 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:27.456756 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-926320a9-3d1e-4e08-a6dd-0a35d0cbdf6a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:27.457233 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-926320a9-3d1e-4e08-a6dd-0a35d0cbdf6a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:27.458179 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-926320a9-3d1e-4e08-a6dd-0a35d0cbdf6a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:27.458610 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-926320a9-3d1e-4e08-a6dd-0a35d0cbdf6a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:27.465027 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:27.595468 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-926320a9-3d1e-4e08-a6dd-0a35d0cbdf6a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:27.604765 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-926320a9-3d1e-4e08-a6dd-0a35d0cbdf6a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:27.606447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-926320a9-3d1e-4e08-a6dd-0a35d0cbdf6a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:27.607613 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-926320a9-3d1e-4e08-a6dd-0a35d0cbdf6a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1407 microversion: 2.20 time: 0.169395 Jul 14 11:48:27.608367 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 271/584] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:27 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:48:27.693542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b4a3e507-739c-4d2d-9b06-4f080053a577 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:27.701960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b4a3e507-739c-4d2d-9b06-4f080053a577 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1674 microversion: 2.1 time: 0.276230 Jul 14 11:48:27.702642 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 314/585] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:27 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1674 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:28.625693 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5249d65e-4c4c-402e-aac0-9de98e10962e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:28.626952 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5249d65e-4c4c-402e-aac0-9de98e10962e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:28.631185 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=4 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:28.632121 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=6 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:28.636991 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5249d65e-4c4c-402e-aac0-9de98e10962e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:28.637486 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5249d65e-4c4c-402e-aac0-9de98e10962e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:28.638603 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5249d65e-4c4c-402e-aac0-9de98e10962e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:28.639526 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5249d65e-4c4c-402e-aac0-9de98e10962e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:28.719227 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b2a8f5d5-1c92-4978-8330-dce411ddb98f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:28.719901 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b2a8f5d5-1c92-4978-8330-dce411ddb98f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:28.723396 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=6 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:28.727423 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2a8f5d5-1c92-4978-8330-dce411ddb98f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:28.728099 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2a8f5d5-1c92-4978-8330-dce411ddb98f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:28.728883 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2a8f5d5-1c92-4978-8330-dce411ddb98f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:28.729354 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2a8f5d5-1c92-4978-8330-dce411ddb98f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:28.800284 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5249d65e-4c4c-402e-aac0-9de98e10962e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:28.808707 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5249d65e-4c4c-402e-aac0-9de98e10962e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:28.810395 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5249d65e-4c4c-402e-aac0-9de98e10962e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:28.811516 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5249d65e-4c4c-402e-aac0-9de98e10962e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1407 microversion: 2.20 time: 0.189700 Jul 14 11:48:28.812072 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 272/586] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:28 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:48:29.225852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b2a8f5d5-1c92-4978-8330-dce411ddb98f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:29.234178 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b2a8f5d5-1c92-4978-8330-dce411ddb98f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1674 microversion: 2.1 time: 0.518752 Jul 14 11:48:29.234758 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 315/587] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:28 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1674 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:29.491381 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-980ed502-675f-42a6-bf94-34e16becdd16 req-bbcc2c7e-517a-4a3f-876f-2499c052d533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88440aae-c9af-4f69-bdae-38f9d81c06a7", "tag": "f79bdd51-95b5-4720-a060-677fe13019be"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:29.502521 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-980ed502-675f-42a6-bf94-34e16becdd16 req-bbcc2c7e-517a-4a3f-876f-2499c052d533 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:29.502903 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-980ed502-675f-42a6-bf94-34e16becdd16 req-bbcc2c7e-517a-4a3f-876f-2499c052d533 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:29.517687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-980ed502-675f-42a6-bf94-34e16becdd16 req-bbcc2c7e-517a-4a3f-876f-2499c052d533 service nova] Creating event network-changed:f79bdd51-95b5-4720-a060-677fe13019be for instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 on hv-cinder-84980 Jul 14 11:48:29.522720 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-980ed502-675f-42a6-bf94-34e16becdd16 req-bbcc2c7e-517a-4a3f-876f-2499c052d533 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034964 Jul 14 11:48:29.523759 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 273/588] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:29.829884 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3e09dc16-2e9f-4075-a926-a454ff145f60 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:29.830568 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3e09dc16-2e9f-4075-a926-a454ff145f60 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:29.838241 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3e09dc16-2e9f-4075-a926-a454ff145f60 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:29.838686 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3e09dc16-2e9f-4075-a926-a454ff145f60 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:29.839474 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3e09dc16-2e9f-4075-a926-a454ff145f60 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:29.839985 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3e09dc16-2e9f-4075-a926-a454ff145f60 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:30.044397 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3e09dc16-2e9f-4075-a926-a454ff145f60 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:30.052876 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3e09dc16-2e9f-4075-a926-a454ff145f60 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:30.054431 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3e09dc16-2e9f-4075-a926-a454ff145f60 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:30.055549 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3e09dc16-2e9f-4075-a926-a454ff145f60 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1407 microversion: 2.20 time: 0.229615 Jul 14 11:48:30.056167 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 316/589] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:29 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:48:30.251832 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-15e5321b-30a7-49b7-b16f-6ca9f6c646af tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:30.253909 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-15e5321b-30a7-49b7-b16f-6ca9f6c646af tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:30.260940 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-15e5321b-30a7-49b7-b16f-6ca9f6c646af tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:30.261413 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-15e5321b-30a7-49b7-b16f-6ca9f6c646af tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:30.262188 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-15e5321b-30a7-49b7-b16f-6ca9f6c646af tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:30.262645 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-15e5321b-30a7-49b7-b16f-6ca9f6c646af tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:30.503078 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-15e5321b-30a7-49b7-b16f-6ca9f6c646af tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:30.515802 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-15e5321b-30a7-49b7-b16f-6ca9f6c646af tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1674 microversion: 2.1 time: 0.268120 Jul 14 11:48:30.517762 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 274/590] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:30 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1674 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:31.074266 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d1a4d0fc-8968-447b-80d1-f3b80b86a475 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:31.074867 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d1a4d0fc-8968-447b-80d1-f3b80b86a475 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:31.089928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d1a4d0fc-8968-447b-80d1-f3b80b86a475 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:31.089928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d1a4d0fc-8968-447b-80d1-f3b80b86a475 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:31.091858 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d1a4d0fc-8968-447b-80d1-f3b80b86a475 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:31.093705 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d1a4d0fc-8968-447b-80d1-f3b80b86a475 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:31.368986 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d1a4d0fc-8968-447b-80d1-f3b80b86a475 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:31.371638 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-60435750-0204-4229-ada1-eff770b44289 req-4af9259b-d8b2-4030-b05b-b43f5924a9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36228e4a-c9d6-4e57-81fe-e8a49d221573", "name": "network-vif-deleted", "tag": "a691a194-3f01-478d-96f7-2e83d0eb6f7d"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:31.380255 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d1a4d0fc-8968-447b-80d1-f3b80b86a475 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:31.382269 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d1a4d0fc-8968-447b-80d1-f3b80b86a475 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:31.383804 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d1a4d0fc-8968-447b-80d1-f3b80b86a475 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1600 microversion: 2.20 time: 0.313927 Jul 14 11:48:31.385480 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 317/591] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:48:31 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1600 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:48:31.400309 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-60435750-0204-4229-ada1-eff770b44289 req-4af9259b-d8b2-4030-b05b-b43f5924a9b2 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:31.400756 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-60435750-0204-4229-ada1-eff770b44289 req-4af9259b-d8b2-4030-b05b-b43f5924a9b2 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:31.402817 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-bd4e20f2-f9c0-4079-a8c8-584e5477fb5a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:31.403333 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-bd4e20f2-f9c0-4079-a8c8-584e5477fb5a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:31.410790 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bd4e20f2-f9c0-4079-a8c8-584e5477fb5a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:31.411382 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bd4e20f2-f9c0-4079-a8c8-584e5477fb5a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:31.413072 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bd4e20f2-f9c0-4079-a8c8-584e5477fb5a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:31.413683 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bd4e20f2-f9c0-4079-a8c8-584e5477fb5a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:31.424784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-60435750-0204-4229-ada1-eff770b44289 req-4af9259b-d8b2-4030-b05b-b43f5924a9b2 service nova] Creating event network-vif-deleted:a691a194-3f01-478d-96f7-2e83d0eb6f7d for instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 on hv-cinder-84980 Jul 14 11:48:31.431495 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-60435750-0204-4229-ada1-eff770b44289 req-4af9259b-d8b2-4030-b05b-b43f5924a9b2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067597 Jul 14 11:48:31.432503 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 275/592] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:48:31.536172 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-1f04c4eb-f0a9-404d-a1a3-2fd820197a37 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:31.537472 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-1f04c4eb-f0a9-404d-a1a3-2fd820197a37 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:31.545399 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1f04c4eb-f0a9-404d-a1a3-2fd820197a37 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:31.546405 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1f04c4eb-f0a9-404d-a1a3-2fd820197a37 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:31.547590 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1f04c4eb-f0a9-404d-a1a3-2fd820197a37 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:31.548279 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1f04c4eb-f0a9-404d-a1a3-2fd820197a37 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:31.611959 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-bd4e20f2-f9c0-4079-a8c8-584e5477fb5a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.213333 Jul 14 11:48:31.615581 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 318/593] 10.222.0.40 () {60 vars in 1315 bytes} [Thu Jul 14 11:48:31 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404/os-interface => generated 285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 11:48:31.644352 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-1f04c4eb-f0a9-404d-a1a3-2fd820197a37 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:31.650585 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-1f04c4eb-f0a9-404d-a1a3-2fd820197a37 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1322 microversion: 2.1 time: 0.118555 Jul 14 11:48:31.653614 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 276/594] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:31 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1322 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:32.141097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-39f5aca3-6aff-48e3-ba58-52154f1b7e77 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:32.143818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-39f5aca3-6aff-48e3-ba58-52154f1b7e77 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:32.151564 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:32.153363 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-39f5aca3-6aff-48e3-ba58-52154f1b7e77 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:32.154196 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-39f5aca3-6aff-48e3-ba58-52154f1b7e77 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:32.155198 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-39f5aca3-6aff-48e3-ba58-52154f1b7e77 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:32.155850 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-39f5aca3-6aff-48e3-ba58-52154f1b7e77 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:32.188219 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-39f5aca3-6aff-48e3-ba58-52154f1b7e77 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/ips" status: 200 len: 150 microversion: 2.1 time: 0.052295 Jul 14 11:48:32.193398 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 319/595] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 11:48:32 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/ips => generated 150 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:32.583882 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-f4538459-6af5-4c10-9d51-bd299002a52f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-963610259"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:32.584403 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-f4538459-6af5-4c10-9d51-bd299002a52f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:32.591558 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f4538459-6af5-4c10-9d51-bd299002a52f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:32.592015 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f4538459-6af5-4c10-9d51-bd299002a52f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:32.592786 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f4538459-6af5-4c10-9d51-bd299002a52f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:32.593251 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f4538459-6af5-4c10-9d51-bd299002a52f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:32.670058 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-26ad1942-7567-4398-abc6-9b36806d15b4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:32.670695 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-26ad1942-7567-4398-abc6-9b36806d15b4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:32.678495 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-26ad1942-7567-4398-abc6-9b36806d15b4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:32.678944 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-26ad1942-7567-4398-abc6-9b36806d15b4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:32.679715 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-26ad1942-7567-4398-abc6-9b36806d15b4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:32.680148 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-26ad1942-7567-4398-abc6-9b36806d15b4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:32.727515 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-26ad1942-7567-4398-abc6-9b36806d15b4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:32.728277 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-26ad1942-7567-4398-abc6-9b36806d15b4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:32.728931 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-26ad1942-7567-4398-abc6-9b36806d15b4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lazy-loading 'fault' on Instance uuid 36228e4a-c9d6-4e57-81fe-e8a49d221573 {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:48:32.740421 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.network.security_group_api [None req-f4538459-6af5-4c10-9d51-bd299002a52f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Adding security group bdcddd37-a8d7-4d2f-9ee3-1d39d05d16e1 to port f79bdd51-95b5-4720-a060-677fe13019be Jul 14 11:48:32.785469 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-26ad1942-7567-4398-abc6-9b36806d15b4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:32.795301 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-26ad1942-7567-4398-abc6-9b36806d15b4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 200 len: 1327 microversion: 2.1 time: 0.129808 Jul 14 11:48:32.796066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 320/596] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:32 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 1327 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:32.860591 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-14ec2e06-0b83-432b-865b-6ae1f87f3bfa req-79588b79-6847-4c80-a5c1-f3570a36cd31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e08c817f-cc75-4c71-8645-51a7a1938404", "tag": "5c8aa46b-5efe-4ab3-b31e-03775de21303"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:32.870751 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-14ec2e06-0b83-432b-865b-6ae1f87f3bfa req-79588b79-6847-4c80-a5c1-f3570a36cd31 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:32.871333 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-14ec2e06-0b83-432b-865b-6ae1f87f3bfa req-79588b79-6847-4c80-a5c1-f3570a36cd31 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:32.884826 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-14ec2e06-0b83-432b-865b-6ae1f87f3bfa req-79588b79-6847-4c80-a5c1-f3570a36cd31 service nova] Creating event network-changed:5c8aa46b-5efe-4ab3-b31e-03775de21303 for instance e08c817f-cc75-4c71-8645-51a7a1938404 on hv-cinder-84980 Jul 14 11:48:32.891061 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-14ec2e06-0b83-432b-865b-6ae1f87f3bfa req-79588b79-6847-4c80-a5c1-f3570a36cd31 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033708 Jul 14 11:48:32.892925 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 321/597] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:48:33.271335 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-f4538459-6af5-4c10-9d51-bd299002a52f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "POST /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/action" status: 202 len: 0 microversion: 2.1 time: 0.691375 Jul 14 11:48:33.271947 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 277/598] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 11:48:32 2022] POST /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/action => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:48:33.282699 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f2d233a1-37c5-49b5-b5d6-87de505ffc9b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:33.283432 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f2d233a1-37c5-49b5-b5d6-87de505ffc9b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:33.293543 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f2d233a1-37c5-49b5-b5d6-87de505ffc9b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:33.294080 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f2d233a1-37c5-49b5-b5d6-87de505ffc9b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:33.294944 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f2d233a1-37c5-49b5-b5d6-87de505ffc9b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:33.295611 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f2d233a1-37c5-49b5-b5d6-87de505ffc9b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:33.455191 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-e45d3f5d-ece1-4eae-a778-ef7e4fbf600f req-680daa7a-8f31-4609-b67e-3c3112d47e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88440aae-c9af-4f69-bdae-38f9d81c06a7", "tag": "f79bdd51-95b5-4720-a060-677fe13019be"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:33.466151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-e45d3f5d-ece1-4eae-a778-ef7e4fbf600f req-680daa7a-8f31-4609-b67e-3c3112d47e27 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:33.466620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-e45d3f5d-ece1-4eae-a778-ef7e4fbf600f req-680daa7a-8f31-4609-b67e-3c3112d47e27 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:33.501670 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-e45d3f5d-ece1-4eae-a778-ef7e4fbf600f req-680daa7a-8f31-4609-b67e-3c3112d47e27 service nova] Creating event network-changed:f79bdd51-95b5-4720-a060-677fe13019be for instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 on hv-cinder-84980 Jul 14 11:48:33.509673 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-e45d3f5d-ece1-4eae-a778-ef7e4fbf600f req-680daa7a-8f31-4609-b67e-3c3112d47e27 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057994 Jul 14 11:48:33.510632 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 278/599] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:33.552659 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f2d233a1-37c5-49b5-b5d6-87de505ffc9b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:33.569223 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f2d233a1-37c5-49b5-b5d6-87de505ffc9b tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1758 microversion: 2.1 time: 0.292034 Jul 14 11:48:33.571951 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 322/600] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:33 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1758 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:33.820429 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6d8d5442-1d06-4daa-b2a8-770c54baf85e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:33.822473 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6d8d5442-1d06-4daa-b2a8-770c54baf85e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:33.830432 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6d8d5442-1d06-4daa-b2a8-770c54baf85e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:33.831479 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6d8d5442-1d06-4daa-b2a8-770c54baf85e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:33.832622 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6d8d5442-1d06-4daa-b2a8-770c54baf85e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:33.833718 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6d8d5442-1d06-4daa-b2a8-770c54baf85e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:33.851791 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-6d8d5442-1d06-4daa-b2a8-770c54baf85e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] HTTP exception thrown: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6d8d5442-1d06-4daa-b2a8-770c54baf85e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Request method failure captured: Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 HTTP/1.1 Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGIz-VVLj5Cn2FeK00spv5i4jycBYb48_psBZTc_hmV4y6eMDaZWost2EUEADSFG1X7rj_Tcbaj1sKJtsRnV5j0rnlTB6MsL2L3ilmuBAkJH4UHaAsls8Zsz4k6CRGrV3bT6szT_JYs4JSJlP56caFYRnZ_t9VH7-GDIQxW2qkXUJE Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 48a88ac7db8a481ca03508d315a0bc56 Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:48:33.855750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:48:33.857414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:48:33.857414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:48:33.857414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 48a88ac7db8a481ca03508d315a0bc56 Jul 14 11:48:33.857414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:48:33.857414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-AttachVolumeTestJSON-1543342879-project Jul 14 11:48:33.857414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:48:33.857414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:48:33.857414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 246f07024efa444da74f2b898f426b46 Jul 14 11:48:33.857414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-AttachVolumeTestJSON-1543342879-project Jul 14 11:48:33.857414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:48:33.857414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. Jul 14 11:48:33.857414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '36228e4a-c9d6-4e57-81fe-e8a49d221573'} Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:48:33.858308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. Jul 14 11:48:33.859694 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:33.871556 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6d8d5442-1d06-4daa-b2a8-770c54baf85e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Returning 404 to user: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:48:33.873054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6d8d5442-1d06-4daa-b2a8-770c54baf85e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 404 len: 111 microversion: 2.1 time: 0.057230 Jul 14 11:48:33.880877 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 279/601] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:33 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:48:33.896774 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-44bd3d39-d1d3-498b-9c35-1cd0e5e1845a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '.version_select at 0x7f1adf60de50>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:33.997372 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-44bd3d39-d1d3-498b-9c35-1cd0e5e1845a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024945688" status: 202 len: 0 microversion: 2.1 time: 0.115393 Jul 14 11:48:33.998353 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 323/602] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jul 14 11:48:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024945688 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:48:34.005681 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-aa075dd1-9210-42b9-b1f8-ec90541937b1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63243b88-f54f-4d77-93dd-d09391c74f48"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:34.006989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-aa075dd1-9210-42b9-b1f8-ec90541937b1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:34.015268 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-aa075dd1-9210-42b9-b1f8-ec90541937b1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:34.016384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-aa075dd1-9210-42b9-b1f8-ec90541937b1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:34.017440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-aa075dd1-9210-42b9-b1f8-ec90541937b1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:34.018111 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-aa075dd1-9210-42b9-b1f8-ec90541937b1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:34.170989 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ff142d2b-630b-4c0c-9b12-7c6bfdd26a41 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:34.172721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ff142d2b-630b-4c0c-9b12-7c6bfdd26a41 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:34.184772 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ff142d2b-630b-4c0c-9b12-7c6bfdd26a41 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:34.185446 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ff142d2b-630b-4c0c-9b12-7c6bfdd26a41 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:34.186570 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ff142d2b-630b-4c0c-9b12-7c6bfdd26a41 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:34.187209 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ff142d2b-630b-4c0c-9b12-7c6bfdd26a41 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:34.217626 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-ff142d2b-630b-4c0c-9b12-7c6bfdd26a41 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lazy-loading 'flavor' on Instance uuid 1c667180-b390-45de-b693-7d59b8369eb6 {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:48:34.622364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ff142d2b-630b-4c0c-9b12-7c6bfdd26a41 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "POST /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/action" status: 200 len: 32 microversion: 2.1 time: 0.466020 Jul 14 11:48:34.624067 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 324/603] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 11:48:34 2022] POST /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/action => generated 32 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:48:34.636636 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3e4c09fc-c183-4682-be85-07575fae703c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:34.651987 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3e4c09fc-c183-4682-be85-07575fae703c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:34.673655 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3e4c09fc-c183-4682-be85-07575fae703c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:34.676256 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3e4c09fc-c183-4682-be85-07575fae703c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:34.678383 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3e4c09fc-c183-4682-be85-07575fae703c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:34.679122 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3e4c09fc-c183-4682-be85-07575fae703c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:34.834259 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3e4c09fc-c183-4682-be85-07575fae703c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:34.842643 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3e4c09fc-c183-4682-be85-07575fae703c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.213077 Jul 14 11:48:34.843597 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 325/604] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:34 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:34.915462 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-aa075dd1-9210-42b9-b1f8-ec90541937b1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "POST /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.928786 Jul 14 11:48:34.916626 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 280/605] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 11:48:33 2022] POST /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/os-volume_attachments => generated 194 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:35.359587 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3c564fb9-abd3-4b4f-af79-8a0dcc583f2e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Action: 'create', calling method: .version_select at 0x7f1adf6f2700>, body: {"keypair": {"name": "tempest-keypair-386723855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrRpB3dtdC9J+r9xhXSBGzxZkRR7pTMgAQJ4UXbt26TLwXpMDxUvk3iVmNzI3zUC2ZWg/Vv5DybmXbh+KU90bCFS8XdvNLB/kd6vfk/Mrhm7raEKD1jhJN94irzMmagLQ=="}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:35.376396 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-3c564fb9-abd3-4b4f-af79-8a0dcc583f2e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Getting quotas for project 48a88ac7db8a481ca03508d315a0bc56. Resources: {'key_pairs'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:48:35.378878 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-3c564fb9-abd3-4b4f-af79-8a0dcc583f2e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Getting quotas for user 246f07024efa444da74f2b898f426b46 and project 48a88ac7db8a481ca03508d315a0bc56. Resources: {'key_pairs'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:48:35.472431 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3c564fb9-abd3-4b4f-af79-8a0dcc583f2e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116591 Jul 14 11:48:35.473007 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 326/606] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 11:48:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:35.860690 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-78d6c34f-29a8-4633-9228-5d7b928f6b44 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:35.861423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-78d6c34f-29a8-4633-9228-5d7b928f6b44 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:35.867834 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-78d6c34f-29a8-4633-9228-5d7b928f6b44 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:35.868723 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-78d6c34f-29a8-4633-9228-5d7b928f6b44 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:35.869540 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-78d6c34f-29a8-4633-9228-5d7b928f6b44 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:35.869973 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-78d6c34f-29a8-4633-9228-5d7b928f6b44 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:36.050494 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-78d6c34f-29a8-4633-9228-5d7b928f6b44 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:36.059225 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-78d6c34f-29a8-4633-9228-5d7b928f6b44 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.203155 Jul 14 11:48:36.059794 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 281/607] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:35 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:37.076750 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-4c9450e5-1a76-40d5-86d5-37fc5f51a875 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:37.077421 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-4c9450e5-1a76-40d5-86d5-37fc5f51a875 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:37.084592 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4c9450e5-1a76-40d5-86d5-37fc5f51a875 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:37.085041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4c9450e5-1a76-40d5-86d5-37fc5f51a875 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:37.085871 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4c9450e5-1a76-40d5-86d5-37fc5f51a875 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:37.095291 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4c9450e5-1a76-40d5-86d5-37fc5f51a875 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:37.559897 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-4c9450e5-1a76-40d5-86d5-37fc5f51a875 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:37.568090 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-4c9450e5-1a76-40d5-86d5-37fc5f51a875 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.496103 Jul 14 11:48:37.568669 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 327/608] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:37 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:37.984266 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-953294794", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87d6f20b-bda5-4229-8026-f520c7f094ed"}], "security_groups": [{"name": "tempest-securitygroup--430482670"}], "key_name": "tempest-keypair-386723855", "user_data": "}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:38.084881 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.network.neutron [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] validate_networks() for [('87d6f20b-bda5-4229-8026-f520c7f094ed', None, None, None, None, None)] {{(pid=124946) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:48:38.451802 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Flavor limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:48:38.452245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Image limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:48:38.452711 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Flavor pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:48:38.453209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Image pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:48:38.453624 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:48:38.462273 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:38.463360 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:38.464187 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:38.464617 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:38.482201 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Getting quotas for project 48a88ac7db8a481ca03508d315a0bc56. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:48:38.486208 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Getting quotas for user 246f07024efa444da74f2b898f426b46 and project 48a88ac7db8a481ca03508d315a0bc56. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:48:38.488491 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:38.497795 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Going to run 1 instances... {{(pid=124946) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:48:38.500061 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124946) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:48:38.584094 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1d9284af-9444-4c15-af2a-7c316814517b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:38.584714 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1d9284af-9444-4c15-af2a-7c316814517b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:38.591936 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1d9284af-9444-4c15-af2a-7c316814517b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:38.592384 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1d9284af-9444-4c15-af2a-7c316814517b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:38.593214 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1d9284af-9444-4c15-af2a-7c316814517b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:38.593658 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1d9284af-9444-4c15-af2a-7c316814517b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:38.626692 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b6362116-6cde-485a-a95e-2b2318ea3c5c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.646535 Jul 14 11:48:38.627365 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 282/609] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:48:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:48:38.639596 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-05599e8b-a722-4f89-83d3-fb5256c4ded6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:38.640276 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-05599e8b-a722-4f89-83d3-fb5256c4ded6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:38.700573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-05599e8b-a722-4f89-83d3-fb5256c4ded6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:38.708084 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-05599e8b-a722-4f89-83d3-fb5256c4ded6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1236 microversion: 2.1 time: 0.074128 Jul 14 11:48:38.708852 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 283/610] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:38 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1236 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:38.738705 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1d9284af-9444-4c15-af2a-7c316814517b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:38.747780 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1d9284af-9444-4c15-af2a-7c316814517b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.167504 Jul 14 11:48:38.751957 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 328/611] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:38 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:39.725567 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-fc6d6b80-e70f-4df3-91ce-619921eca59a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:39.726181 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-fc6d6b80-e70f-4df3-91ce-619921eca59a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:39.733375 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fc6d6b80-e70f-4df3-91ce-619921eca59a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:39.733822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fc6d6b80-e70f-4df3-91ce-619921eca59a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:39.734591 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fc6d6b80-e70f-4df3-91ce-619921eca59a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:39.735021 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fc6d6b80-e70f-4df3-91ce-619921eca59a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:39.767812 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-da6ef268-36e3-46d8-a457-ff64f466f499 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:39.768735 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-da6ef268-36e3-46d8-a457-ff64f466f499 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:39.776020 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-da6ef268-36e3-46d8-a457-ff64f466f499 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:39.776580 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-da6ef268-36e3-46d8-a457-ff64f466f499 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:39.777449 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-da6ef268-36e3-46d8-a457-ff64f466f499 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:39.778163 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-da6ef268-36e3-46d8-a457-ff64f466f499 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:39.797756 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-fc6d6b80-e70f-4df3-91ce-619921eca59a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:39.806808 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-fc6d6b80-e70f-4df3-91ce-619921eca59a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1240 microversion: 2.1 time: 0.084454 Jul 14 11:48:39.807452 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 284/612] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:39 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:39.916993 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-da6ef268-36e3-46d8-a457-ff64f466f499 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:39.924963 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-da6ef268-36e3-46d8-a457-ff64f466f499 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.164437 Jul 14 11:48:39.925568 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 329/613] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:39 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:40.823287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-04180955-1682-491d-8106-6e94bbb40a6a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:40.823929 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-04180955-1682-491d-8106-6e94bbb40a6a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:40.830550 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-04180955-1682-491d-8106-6e94bbb40a6a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:40.831006 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-04180955-1682-491d-8106-6e94bbb40a6a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:40.831776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-04180955-1682-491d-8106-6e94bbb40a6a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:40.832216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-04180955-1682-491d-8106-6e94bbb40a6a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:40.836348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:40.901482 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-04180955-1682-491d-8106-6e94bbb40a6a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:40.909112 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-04180955-1682-491d-8106-6e94bbb40a6a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1306 microversion: 2.1 time: 0.089765 Jul 14 11:48:40.909907 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 285/614] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:40 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1306 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:40.942772 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c35fe34b-b6a5-477f-b4a5-ecced60fda2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:40.943777 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c35fe34b-b6a5-477f-b4a5-ecced60fda2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:40.950163 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c35fe34b-b6a5-477f-b4a5-ecced60fda2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:40.950606 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c35fe34b-b6a5-477f-b4a5-ecced60fda2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:40.951898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c35fe34b-b6a5-477f-b4a5-ecced60fda2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:40.951898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c35fe34b-b6a5-477f-b4a5-ecced60fda2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:41.088865 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c35fe34b-b6a5-477f-b4a5-ecced60fda2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:41.097150 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c35fe34b-b6a5-477f-b4a5-ecced60fda2e tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.158321 Jul 14 11:48:41.097760 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 330/615] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:40 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:41.933467 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-533f3556-6c9b-409d-8246-a286adcb0308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:41.934641 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-533f3556-6c9b-409d-8246-a286adcb0308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:41.942108 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-533f3556-6c9b-409d-8246-a286adcb0308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:41.942789 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-533f3556-6c9b-409d-8246-a286adcb0308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:41.943953 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-533f3556-6c9b-409d-8246-a286adcb0308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:41.944597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-533f3556-6c9b-409d-8246-a286adcb0308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:42.115663 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-508ffac9-36e4-4805-801b-a131930a42bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:42.120611 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-508ffac9-36e4-4805-801b-a131930a42bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:42.126147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-508ffac9-36e4-4805-801b-a131930a42bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:42.126796 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-508ffac9-36e4-4805-801b-a131930a42bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:42.127783 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-508ffac9-36e4-4805-801b-a131930a42bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:42.128384 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-508ffac9-36e4-4805-801b-a131930a42bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:42.149192 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-533f3556-6c9b-409d-8246-a286adcb0308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:42.156363 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-533f3556-6c9b-409d-8246-a286adcb0308 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1361 microversion: 2.1 time: 0.228909 Jul 14 11:48:42.158111 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 286/616] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:41 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:42.276030 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-508ffac9-36e4-4805-801b-a131930a42bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:42.283019 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-508ffac9-36e4-4805-801b-a131930a42bd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.171283 Jul 14 11:48:42.284021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 331/617] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:42 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:42.304080 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-e9737afc-a815-474b-b1af-1f2bf6b00b1c req-7bd3d793-f7dd-4ece-8843-424a39549f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9a7ce6-aede-493e-8e91-b35f4c51d954", "tag": "9e3c7542-e076-4781-be94-f9cf16cf7f57"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:42.345425 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-e9737afc-a815-474b-b1af-1f2bf6b00b1c req-7bd3d793-f7dd-4ece-8843-424a39549f74 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:42.346396 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-e9737afc-a815-474b-b1af-1f2bf6b00b1c req-7bd3d793-f7dd-4ece-8843-424a39549f74 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:42.361641 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-e9737afc-a815-474b-b1af-1f2bf6b00b1c req-7bd3d793-f7dd-4ece-8843-424a39549f74 service nova] Creating event network-changed:9e3c7542-e076-4781-be94-f9cf16cf7f57 for instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 on hv-cinder-84980 Jul 14 11:48:42.372095 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-e9737afc-a815-474b-b1af-1f2bf6b00b1c req-7bd3d793-f7dd-4ece-8843-424a39549f74 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071154 Jul 14 11:48:42.372724 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 287/618] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:42.464332 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-aa86b3e3-b9dd-48e8-a8a7-740f81c61fea tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63243b88-f54f-4d77-93dd-d09391c74f48"}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:42.465505 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-aa86b3e3-b9dd-48e8-a8a7-740f81c61fea tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:42.472085 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aa86b3e3-b9dd-48e8-a8a7-740f81c61fea tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:42.472529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aa86b3e3-b9dd-48e8-a8a7-740f81c61fea tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:42.474113 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aa86b3e3-b9dd-48e8-a8a7-740f81c61fea tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:42.474727 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aa86b3e3-b9dd-48e8-a8a7-740f81c61fea tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:42.479761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:42.559664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-aa86b3e3-b9dd-48e8-a8a7-740f81c61fea tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] HTTP exception thrown: Invalid volume: volume 63243b88-f54f-4d77-93dd-d09391c74f48 is already attached to instances: 72ebe862-edb8-480e-9c0d-02a791c8160b Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-aa86b3e3-b9dd-48e8-a8a7-740f81c61fea tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Request method failure captured: Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: POST /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/os-volume_attachments HTTP/1.1 Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 74 Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AGNrCXQELDmNK7QTgAsdlJtPBM_GXw3pFQ92I5FXg_Nl7xnN8erDQ0jD6cBgqZwNWgSGDIvH_OU-IJPWW0i2GmYKcnE8wD4a47a9DJeOO5JgDloTkiJ3A6EcxYhG-symYmW7J8b_ws3S47CzQaA9KAgAK_QrTjwz8qGsPABa7uBQLs Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:48:42.561542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:48:42.563115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f274d555f5c746cc885394c699b3d767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f274d555f5c746cc885394c699b3d767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:48:42.563115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:48:42.563115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:48:42.563115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:48:42.563115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:48:42.563115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:48:42.563115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:48:42.563115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 8773c88f88614a9d903f667305a217e0 Jul 14 11:48:42.563115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:48:42.563115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Jul 14 11:48:42.563115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {"volumeAttachment": {"volumeId": "63243b88-f54f-4d77-93dd-d09391c74f48"}} Jul 14 11:48:42.563115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Invalid volume: volume 63243b88-f54f-4d77-93dd-d09391c74f48 is already attached to instances: 72ebe862-edb8-480e-9c0d-02a791c8160b Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'server_id': '72ebe862-edb8-480e-9c0d-02a791c8160b', 'body': {'volumeAttachment': {'volumeId': '63243b88-f54f-4d77-93dd-d09391c74f48'}}} Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 63243b88-f54f-4d77-93dd-d09391c74f48 is already attached to instances: 72ebe862-edb8-480e-9c0d-02a791c8160b Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:48:42.563998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 63243b88-f54f-4d77-93dd-d09391c74f48 is already attached to instances: 72ebe862-edb8-480e-9c0d-02a791c8160b Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:48:42.565523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:48:42.570231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:48:42.570231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:48:42.570231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:48:42.570231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 63243b88-f54f-4d77-93dd-d09391c74f48 is already attached to instances: 72ebe862-edb8-480e-9c0d-02a791c8160b Jul 14 11:48:42.570231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:48:42.570231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-aa86b3e3-b9dd-48e8-a8a7-740f81c61fea tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Returning 400 to user: Invalid volume: volume 63243b88-f54f-4d77-93dd-d09391c74f48 is already attached to instances: 72ebe862-edb8-480e-9c0d-02a791c8160b {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:48:42.570231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-aa86b3e3-b9dd-48e8-a8a7-740f81c61fea tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "POST /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104688 Jul 14 11:48:42.570231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 332/619] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 11:48:42 2022] POST /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:48:42.627905 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-536998c2-84b3-4317-a102-158a944eba8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:42.628516 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-536998c2-84b3-4317-a102-158a944eba8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:42.634886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-536998c2-84b3-4317-a102-158a944eba8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:42.635339 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-536998c2-84b3-4317-a102-158a944eba8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:42.636111 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-536998c2-84b3-4317-a102-158a944eba8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:42.636539 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-536998c2-84b3-4317-a102-158a944eba8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:42.718793 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-536998c2-84b3-4317-a102-158a944eba8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lazy-loading 'services' on Instance uuid 72ebe862-edb8-480e-9c0d-02a791c8160b {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:48:42.954474 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-536998c2-84b3-4317-a102-158a944eba8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "DELETE /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/os-volume_attachments/63243b88-f54f-4d77-93dd-d09391c74f48" status: 202 len: 0 microversion: 2.1 time: 0.330599 Jul 14 11:48:42.955130 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 288/620] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 11:48:42 2022] DELETE /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/os-volume_attachments/63243b88-f54f-4d77-93dd-d09391c74f48 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:48:42.963993 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7d13338d-5983-4e71-80b5-397664922e50 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:42.964968 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7d13338d-5983-4e71-80b5-397664922e50 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:42.971552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7d13338d-5983-4e71-80b5-397664922e50 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:42.971994 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7d13338d-5983-4e71-80b5-397664922e50 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:42.972754 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7d13338d-5983-4e71-80b5-397664922e50 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:42.973224 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7d13338d-5983-4e71-80b5-397664922e50 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:43.004833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7d13338d-5983-4e71-80b5-397664922e50 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045413 Jul 14 11:48:43.005439 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 333/621] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:48:42 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:43.177667 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-dd45ca72-08e8-4275-9676-e104522eadf7 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:43.177667 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-dd45ca72-08e8-4275-9676-e104522eadf7 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:43.183045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd45ca72-08e8-4275-9676-e104522eadf7 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:43.183497 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd45ca72-08e8-4275-9676-e104522eadf7 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:43.184268 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd45ca72-08e8-4275-9676-e104522eadf7 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:43.184714 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd45ca72-08e8-4275-9676-e104522eadf7 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:43.300234 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2ede156c-a950-45a7-82db-7af583c49d7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:43.300843 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2ede156c-a950-45a7-82db-7af583c49d7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:43.308194 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ede156c-a950-45a7-82db-7af583c49d7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:43.308642 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ede156c-a950-45a7-82db-7af583c49d7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:43.309442 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ede156c-a950-45a7-82db-7af583c49d7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:43.309878 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2ede156c-a950-45a7-82db-7af583c49d7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:43.319236 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-dd45ca72-08e8-4275-9676-e104522eadf7 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:43.327664 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-dd45ca72-08e8-4275-9676-e104522eadf7 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1361 microversion: 2.1 time: 0.156503 Jul 14 11:48:43.328587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 289/622] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:43 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:43.449676 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2ede156c-a950-45a7-82db-7af583c49d7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:43.457515 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2ede156c-a950-45a7-82db-7af583c49d7c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.161123 Jul 14 11:48:43.458075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 334/623] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:43 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:44.018926 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-900637e3-f8ab-425e-a5f5-bf9a18a3f0db tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:44.020122 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-900637e3-f8ab-425e-a5f5-bf9a18a3f0db tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:44.028489 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-900637e3-f8ab-425e-a5f5-bf9a18a3f0db tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:44.028936 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-900637e3-f8ab-425e-a5f5-bf9a18a3f0db tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:44.029848 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-900637e3-f8ab-425e-a5f5-bf9a18a3f0db tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:44.033265 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-900637e3-f8ab-425e-a5f5-bf9a18a3f0db tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:44.059680 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-900637e3-f8ab-425e-a5f5-bf9a18a3f0db tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045428 Jul 14 11:48:44.060160 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 290/624] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:48:44 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:44.344781 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ecc67a2e-8f2b-439c-829b-2a3f3eb7c17e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:44.345378 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ecc67a2e-8f2b-439c-829b-2a3f3eb7c17e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:44.352038 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ecc67a2e-8f2b-439c-829b-2a3f3eb7c17e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:44.352486 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ecc67a2e-8f2b-439c-829b-2a3f3eb7c17e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:44.353326 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ecc67a2e-8f2b-439c-829b-2a3f3eb7c17e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:44.353762 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ecc67a2e-8f2b-439c-829b-2a3f3eb7c17e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:44.475033 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-78c08938-65e8-4182-91ab-6528859cf355 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:44.475654 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-78c08938-65e8-4182-91ab-6528859cf355 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:44.481835 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-78c08938-65e8-4182-91ab-6528859cf355 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:44.482277 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-78c08938-65e8-4182-91ab-6528859cf355 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:44.483048 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-78c08938-65e8-4182-91ab-6528859cf355 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:44.483483 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-78c08938-65e8-4182-91ab-6528859cf355 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:44.491269 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ecc67a2e-8f2b-439c-829b-2a3f3eb7c17e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:44.498782 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ecc67a2e-8f2b-439c-829b-2a3f3eb7c17e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1361 microversion: 2.1 time: 0.157998 Jul 14 11:48:44.499462 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 335/625] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:44 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:44.708528 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-78c08938-65e8-4182-91ab-6528859cf355 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:44.716566 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-78c08938-65e8-4182-91ab-6528859cf355 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.245427 Jul 14 11:48:44.717357 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 291/626] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:44 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:45.071460 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-425f361f-9c2e-4fab-b9c2-bb1b85a401cc tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:45.072468 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-425f361f-9c2e-4fab-b9c2-bb1b85a401cc tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:45.078988 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-425f361f-9c2e-4fab-b9c2-bb1b85a401cc tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:45.079441 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-425f361f-9c2e-4fab-b9c2-bb1b85a401cc tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:45.080216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-425f361f-9c2e-4fab-b9c2-bb1b85a401cc tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:45.080654 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-425f361f-9c2e-4fab-b9c2-bb1b85a401cc tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:45.108984 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-425f361f-9c2e-4fab-b9c2-bb1b85a401cc tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041536 Jul 14 11:48:45.109583 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 336/627] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:48:45 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:48:45.166133 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-44a7c4c0-c8dd-4037-a588-16ebf3b7e91c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:45.166661 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-44a7c4c0-c8dd-4037-a588-16ebf3b7e91c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:45.173509 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-44a7c4c0-c8dd-4037-a588-16ebf3b7e91c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:45.177557 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-44a7c4c0-c8dd-4037-a588-16ebf3b7e91c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:45.177557 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-44a7c4c0-c8dd-4037-a588-16ebf3b7e91c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:45.177557 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-44a7c4c0-c8dd-4037-a588-16ebf3b7e91c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:45.200368 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-44a7c4c0-c8dd-4037-a588-16ebf3b7e91c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Going to try to terminate instance {{(pid=124946) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:48:45.499081 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-44a7c4c0-c8dd-4037-a588-16ebf3b7e91c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "DELETE /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 204 len: 0 microversion: 2.1 time: 0.336854 Jul 14 11:48:45.499614 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 292/628] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:48:45 2022] DELETE /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:48:45.507886 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-da20b802-f3d9-41c2-89d2-9bde8099846e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:45.514153 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-da20b802-f3d9-41c2-89d2-9bde8099846e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:45.514153 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=4 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:45.516316 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4d3f7380-aa42-42af-bd11-eab50c6d81e6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:45.517045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-4d3f7380-aa42-42af-bd11-eab50c6d81e6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:45.517270 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-da20b802-f3d9-41c2-89d2-9bde8099846e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:45.517725 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-da20b802-f3d9-41c2-89d2-9bde8099846e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:45.518505 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-da20b802-f3d9-41c2-89d2-9bde8099846e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:45.518945 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-da20b802-f3d9-41c2-89d2-9bde8099846e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:45.523074 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4d3f7380-aa42-42af-bd11-eab50c6d81e6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:45.523782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4d3f7380-aa42-42af-bd11-eab50c6d81e6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:45.524552 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4d3f7380-aa42-42af-bd11-eab50c6d81e6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:45.525526 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4d3f7380-aa42-42af-bd11-eab50c6d81e6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:45.652820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-da20b802-f3d9-41c2-89d2-9bde8099846e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:45.657604 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-4d3f7380-aa42-42af-bd11-eab50c6d81e6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:45.660508 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-da20b802-f3d9-41c2-89d2-9bde8099846e tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1680 microversion: 2.1 time: 0.156603 Jul 14 11:48:45.661084 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 337/629] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:45 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:45.665229 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-4d3f7380-aa42-42af-bd11-eab50c6d81e6 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1361 microversion: 2.1 time: 0.153065 Jul 14 11:48:45.666408 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 293/630] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:45 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:45.734643 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c8f2395d-e902-4e1f-ad73-97b9c92f6262 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:45.735364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c8f2395d-e902-4e1f-ad73-97b9c92f6262 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:45.742182 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c8f2395d-e902-4e1f-ad73-97b9c92f6262 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:45.742786 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c8f2395d-e902-4e1f-ad73-97b9c92f6262 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:45.743560 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c8f2395d-e902-4e1f-ad73-97b9c92f6262 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:45.744004 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c8f2395d-e902-4e1f-ad73-97b9c92f6262 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:45.874359 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c8f2395d-e902-4e1f-ad73-97b9c92f6262 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:45.882619 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c8f2395d-e902-4e1f-ad73-97b9c92f6262 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.151825 Jul 14 11:48:45.883203 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 338/631] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:45 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:46.677303 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6d82cb5a-cbd1-4f08-9e58-4ece503ea217 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:46.677888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6d82cb5a-cbd1-4f08-9e58-4ece503ea217 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:46.682470 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-88c1f50e-d8dd-4bb8-aafc-150260fccfc3 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:46.683112 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-88c1f50e-d8dd-4bb8-aafc-150260fccfc3 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:46.684393 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6d82cb5a-cbd1-4f08-9e58-4ece503ea217 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:46.685024 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6d82cb5a-cbd1-4f08-9e58-4ece503ea217 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:46.685817 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6d82cb5a-cbd1-4f08-9e58-4ece503ea217 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:46.686249 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6d82cb5a-cbd1-4f08-9e58-4ece503ea217 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:46.689711 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-88c1f50e-d8dd-4bb8-aafc-150260fccfc3 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:46.690189 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-88c1f50e-d8dd-4bb8-aafc-150260fccfc3 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:46.690966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-88c1f50e-d8dd-4bb8-aafc-150260fccfc3 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:46.691406 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-88c1f50e-d8dd-4bb8-aafc-150260fccfc3 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:46.821509 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6d82cb5a-cbd1-4f08-9e58-4ece503ea217 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:46.828018 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-88c1f50e-d8dd-4bb8-aafc-150260fccfc3 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:46.830563 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6d82cb5a-cbd1-4f08-9e58-4ece503ea217 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1680 microversion: 2.1 time: 0.156093 Jul 14 11:48:46.830563 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 294/632] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:46 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:46.835964 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-88c1f50e-d8dd-4bb8-aafc-150260fccfc3 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1361 microversion: 2.1 time: 0.157309 Jul 14 11:48:46.836564 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 339/633] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:46 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:46.900713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9d362f64-3b51-431a-8e37-bd0dfc1c2f1a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:46.901347 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9d362f64-3b51-431a-8e37-bd0dfc1c2f1a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:46.907355 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9d362f64-3b51-431a-8e37-bd0dfc1c2f1a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:46.907800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9d362f64-3b51-431a-8e37-bd0dfc1c2f1a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:46.908549 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9d362f64-3b51-431a-8e37-bd0dfc1c2f1a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:46.909007 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9d362f64-3b51-431a-8e37-bd0dfc1c2f1a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:47.037487 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9d362f64-3b51-431a-8e37-bd0dfc1c2f1a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:47.049264 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9d362f64-3b51-431a-8e37-bd0dfc1c2f1a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.153202 Jul 14 11:48:47.050074 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 295/634] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:46 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:47.847611 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-82f9b640-9986-48da-ba45-0f5e4205987a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:47.848241 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-82f9b640-9986-48da-ba45-0f5e4205987a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:47.856630 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-82f9b640-9986-48da-ba45-0f5e4205987a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:47.856825 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-71e7f051-81a0-446a-95be-b73d0d3aea96 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:47.857253 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-82f9b640-9986-48da-ba45-0f5e4205987a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:47.857458 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-71e7f051-81a0-446a-95be-b73d0d3aea96 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:47.857933 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-82f9b640-9986-48da-ba45-0f5e4205987a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:47.858403 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-82f9b640-9986-48da-ba45-0f5e4205987a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:47.864339 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-71e7f051-81a0-446a-95be-b73d0d3aea96 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:47.864903 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-71e7f051-81a0-446a-95be-b73d0d3aea96 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:47.866244 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-71e7f051-81a0-446a-95be-b73d0d3aea96 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:47.866667 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-71e7f051-81a0-446a-95be-b73d0d3aea96 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:48.002292 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-82f9b640-9986-48da-ba45-0f5e4205987a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:48.011496 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-82f9b640-9986-48da-ba45-0f5e4205987a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1680 microversion: 2.1 time: 0.167765 Jul 14 11:48:48.012113 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 340/635] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:47 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:48.067358 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-768c91f6-0f40-4ef7-be9f-20fee6fccc5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:48.067962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-768c91f6-0f40-4ef7-be9f-20fee6fccc5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:48.074723 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-768c91f6-0f40-4ef7-be9f-20fee6fccc5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:48.075169 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-768c91f6-0f40-4ef7-be9f-20fee6fccc5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:48.075940 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-768c91f6-0f40-4ef7-be9f-20fee6fccc5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:48.076365 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-768c91f6-0f40-4ef7-be9f-20fee6fccc5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:48.113297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-71e7f051-81a0-446a-95be-b73d0d3aea96 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:48.121906 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-71e7f051-81a0-446a-95be-b73d0d3aea96 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1361 microversion: 2.1 time: 0.269352 Jul 14 11:48:48.124852 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 296/636] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:47 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:48.218802 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-768c91f6-0f40-4ef7-be9f-20fee6fccc5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:48.229034 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-768c91f6-0f40-4ef7-be9f-20fee6fccc5c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.165477 Jul 14 11:48:48.229898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 341/637] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:48 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:48.292992 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-45b770f7-fad9-4e88-b729-823d5ed363ab req-f9624271-43c1-487d-b032-617a448f8f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ebe862-edb8-480e-9c0d-02a791c8160b", "name": "network-vif-deleted", "tag": "5e6cb4bd-c1db-46aa-aa0f-3f63a312e386"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:48.303757 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-45b770f7-fad9-4e88-b729-823d5ed363ab req-f9624271-43c1-487d-b032-617a448f8f81 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:48.303757 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-45b770f7-fad9-4e88-b729-823d5ed363ab req-f9624271-43c1-487d-b032-617a448f8f81 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:48.315580 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-45b770f7-fad9-4e88-b729-823d5ed363ab req-f9624271-43c1-487d-b032-617a448f8f81 service nova] Creating event network-vif-deleted:5e6cb4bd-c1db-46aa-aa0f-3f63a312e386 for instance 72ebe862-edb8-480e-9c0d-02a791c8160b on hv-cinder-84980 Jul 14 11:48:48.320609 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-45b770f7-fad9-4e88-b729-823d5ed363ab req-f9624271-43c1-487d-b032-617a448f8f81 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031471 Jul 14 11:48:48.322106 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 297/638] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:49.029577 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-0c0d5118-9b8f-428e-ac93-96524db965b5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:49.030329 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-0c0d5118-9b8f-428e-ac93-96524db965b5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:49.036979 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0c0d5118-9b8f-428e-ac93-96524db965b5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:49.037538 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0c0d5118-9b8f-428e-ac93-96524db965b5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:49.038321 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0c0d5118-9b8f-428e-ac93-96524db965b5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:49.038765 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0c0d5118-9b8f-428e-ac93-96524db965b5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:49.070837 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0c0d5118-9b8f-428e-ac93-96524db965b5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:49.071289 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0c0d5118-9b8f-428e-ac93-96524db965b5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:49.072289 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-0c0d5118-9b8f-428e-ac93-96524db965b5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lazy-loading 'fault' on Instance uuid 72ebe862-edb8-480e-9c0d-02a791c8160b {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:48:49.119051 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-0c0d5118-9b8f-428e-ac93-96524db965b5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:49.126829 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-0c0d5118-9b8f-428e-ac93-96524db965b5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 200 len: 1331 microversion: 2.1 time: 0.101871 Jul 14 11:48:49.127524 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 342/639] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:49 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:49.140349 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a7e9f458-df53-480d-a801-e25613ad706e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:49.144538 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a7e9f458-df53-480d-a801-e25613ad706e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:49.144538 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:49.144538 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=8 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:49.150860 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a7e9f458-df53-480d-a801-e25613ad706e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:49.151311 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a7e9f458-df53-480d-a801-e25613ad706e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:49.152093 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a7e9f458-df53-480d-a801-e25613ad706e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:49.152535 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a7e9f458-df53-480d-a801-e25613ad706e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:49.245919 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-08791701-2eab-4ec2-90af-f98ca5291e3c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:49.246540 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-08791701-2eab-4ec2-90af-f98ca5291e3c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:49.258163 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-08791701-2eab-4ec2-90af-f98ca5291e3c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:49.261223 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-08791701-2eab-4ec2-90af-f98ca5291e3c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:49.261223 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-08791701-2eab-4ec2-90af-f98ca5291e3c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:49.261223 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-08791701-2eab-4ec2-90af-f98ca5291e3c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:49.318632 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a7e9f458-df53-480d-a801-e25613ad706e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:49.330842 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a7e9f458-df53-480d-a801-e25613ad706e tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1361 microversion: 2.1 time: 0.194623 Jul 14 11:48:49.331882 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 298/640] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:49 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:49.386473 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-34fae775-f14d-4b42-98ab-0dac62244c9a req-23505efc-714c-4125-ac45-56dc1d432122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a9a7ce6-aede-493e-8e91-b35f4c51d954", "name": "network-vif-plugged", "status": "completed", "tag": "9e3c7542-e076-4781-be94-f9cf16cf7f57"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:49.401827 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-34fae775-f14d-4b42-98ab-0dac62244c9a req-23505efc-714c-4125-ac45-56dc1d432122 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:49.402829 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-34fae775-f14d-4b42-98ab-0dac62244c9a req-23505efc-714c-4125-ac45-56dc1d432122 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:49.421790 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-34fae775-f14d-4b42-98ab-0dac62244c9a req-23505efc-714c-4125-ac45-56dc1d432122 service nova] Creating event network-vif-plugged:9e3c7542-e076-4781-be94-f9cf16cf7f57 for instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 on hv-cinder-84980 Jul 14 11:48:49.427001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-34fae775-f14d-4b42-98ab-0dac62244c9a req-23505efc-714c-4125-ac45-56dc1d432122 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045257 Jul 14 11:48:49.427683 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 299/641] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:48:49.451442 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-08791701-2eab-4ec2-90af-f98ca5291e3c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:49.462565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-08791701-2eab-4ec2-90af-f98ca5291e3c tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.220677 Jul 14 11:48:49.463910 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 343/642] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:49 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:50.144611 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-33016fc0-baed-4dee-af9d-5b4b04712c1a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:50.145327 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-33016fc0-baed-4dee-af9d-5b4b04712c1a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:50.152843 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-33016fc0-baed-4dee-af9d-5b4b04712c1a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:50.153319 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-33016fc0-baed-4dee-af9d-5b4b04712c1a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:50.155862 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-33016fc0-baed-4dee-af9d-5b4b04712c1a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:50.155862 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-33016fc0-baed-4dee-af9d-5b4b04712c1a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:50.167399 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-33016fc0-baed-4dee-af9d-5b4b04712c1a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] HTTP exception thrown: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-33016fc0-baed-4dee-af9d-5b4b04712c1a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Request method failure captured: Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b HTTP/1.1 Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGNrCXQELDmNK7QTgAsdlJtPBM_GXw3pFQ92I5FXg_Nl7xnN8erDQ0jD6cBgqZwNWgSGDIvH_OU-IJPWW0i2GmYKcnE8wD4a47a9DJeOO5JgDloTkiJ3A6EcxYhG-symYmW7J8b_ws3S47CzQaA9KAgAK_QrTjwz8qGsPABa7uBQLs Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:48:50.169210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:48:50.170840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f274d555f5c746cc885394c699b3d767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f274d555f5c746cc885394c699b3d767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:48:50.170840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:48:50.170840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:48:50.170840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:48:50.170840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:48:50.170840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:48:50.170840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:48:50.170840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 8773c88f88614a9d903f667305a217e0 Jul 14 11:48:50.170840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:48:50.170840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:48:50.170840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. Jul 14 11:48:50.170840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '72ebe862-edb8-480e-9c0d-02a791c8160b'} Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:48:50.172419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. Jul 14 11:48:50.173868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:50.175069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-33016fc0-baed-4dee-af9d-5b4b04712c1a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Returning 404 to user: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:48:50.175069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-33016fc0-baed-4dee-af9d-5b4b04712c1a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 404 len: 111 microversion: 2.1 time: 0.030570 Jul 14 11:48:50.175069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 300/643] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:50 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:48:50.179480 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-53f08d91-41cd-490e-98aa-80c5502d8e5c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '.version_select at 0x7f1adf6409d0>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:50.271035 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-53f08d91-41cd-490e-98aa-80c5502d8e5c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-107821029" status: 202 len: 0 microversion: 2.1 time: 0.095359 Jul 14 11:48:50.271630 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 344/644] 10.222.0.40 () {58 vars in 1217 bytes} [Thu Jul 14 11:48:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-107821029 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:48:50.347784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ec6b3e71-ec4c-416c-bbf5-291028b091de tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:50.348555 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ec6b3e71-ec4c-416c-bbf5-291028b091de tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:50.355064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ec6b3e71-ec4c-416c-bbf5-291028b091de tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:50.355518 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ec6b3e71-ec4c-416c-bbf5-291028b091de tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:50.356292 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ec6b3e71-ec4c-416c-bbf5-291028b091de tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:50.356728 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ec6b3e71-ec4c-416c-bbf5-291028b091de tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:50.481288 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-29d20354-3f16-454b-a00a-02b0195141a6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:50.482005 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-29d20354-3f16-454b-a00a-02b0195141a6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:50.489223 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-29d20354-3f16-454b-a00a-02b0195141a6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:50.489223 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-29d20354-3f16-454b-a00a-02b0195141a6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:50.489865 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-29d20354-3f16-454b-a00a-02b0195141a6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:50.490804 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-29d20354-3f16-454b-a00a-02b0195141a6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:50.492425 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ec6b3e71-ec4c-416c-bbf5-291028b091de tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:50.504521 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ec6b3e71-ec4c-416c-bbf5-291028b091de tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1361 microversion: 2.1 time: 0.160433 Jul 14 11:48:50.505601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 301/645] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:50 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:50.634091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-29d20354-3f16-454b-a00a-02b0195141a6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:50.642161 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-29d20354-3f16-454b-a00a-02b0195141a6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.165591 Jul 14 11:48:50.642793 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 345/646] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:50 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:51.018755 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-029ac5ee-fafa-4160-8353-a416313e5198 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Action: 'create', calling method: .version_select at 0x7f1adf539dc0>, body: {"keypair": {"name": "tempest-keypair-299555300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECaZk047wVyifx/tBhFlmhmL3Rdgqxt2TdzKGQQ7QVpPFcYLsbnpETt6PtWGRHc0EwSH9/r8iJUk1lEmPltG7qfuGtyXKGlw4APyM0SvTbTcQ8ANzudTk7ohICJfg2RoQ=="}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:51.034512 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-029ac5ee-fafa-4160-8353-a416313e5198 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for project f274d555f5c746cc885394c699b3d767. Resources: {'key_pairs'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:48:51.038441 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-029ac5ee-fafa-4160-8353-a416313e5198 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for user 8773c88f88614a9d903f667305a217e0 and project f274d555f5c746cc885394c699b3d767. Resources: {'key_pairs'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:48:51.139642 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-029ac5ee-fafa-4160-8353-a416313e5198 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124919 Jul 14 11:48:51.140247 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 302/647] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 11:48:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:51.524150 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-14d8b1d3-3700-471c-b3a9-db6c13f87286 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:51.524770 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-14d8b1d3-3700-471c-b3a9-db6c13f87286 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:51.531214 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-14d8b1d3-3700-471c-b3a9-db6c13f87286 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:51.531781 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-14d8b1d3-3700-471c-b3a9-db6c13f87286 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:51.532548 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-14d8b1d3-3700-471c-b3a9-db6c13f87286 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:51.533020 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-14d8b1d3-3700-471c-b3a9-db6c13f87286 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:51.659941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-dd0b23cb-6dbb-4a1b-9cac-1049c8b57f00 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:51.660774 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-dd0b23cb-6dbb-4a1b-9cac-1049c8b57f00 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:51.667385 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd0b23cb-6dbb-4a1b-9cac-1049c8b57f00 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:51.667835 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd0b23cb-6dbb-4a1b-9cac-1049c8b57f00 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:51.668599 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd0b23cb-6dbb-4a1b-9cac-1049c8b57f00 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:51.669042 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd0b23cb-6dbb-4a1b-9cac-1049c8b57f00 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:51.671948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:51.688314 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-14d8b1d3-3700-471c-b3a9-db6c13f87286 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:51.695752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-14d8b1d3-3700-471c-b3a9-db6c13f87286 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1547 microversion: 2.1 time: 0.177229 Jul 14 11:48:51.696329 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 346/648] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:51 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1547 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:51.713048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6e03e877-1538-4ee4-81ee-6bc4f306d80a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:51.713580 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6e03e877-1538-4ee4-81ee-6bc4f306d80a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:51.721096 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6e03e877-1538-4ee4-81ee-6bc4f306d80a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:51.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6e03e877-1538-4ee4-81ee-6bc4f306d80a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:51.722406 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6e03e877-1538-4ee4-81ee-6bc4f306d80a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:51.722919 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6e03e877-1538-4ee4-81ee-6bc4f306d80a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:51.831956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6e03e877-1538-4ee4-81ee-6bc4f306d80a tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122762 Jul 14 11:48:51.832565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 347/649] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jul 14 11:48:51 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:52.062630 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-dd0b23cb-6dbb-4a1b-9cac-1049c8b57f00 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:52.071021 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-dd0b23cb-6dbb-4a1b-9cac-1049c8b57f00 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.414917 Jul 14 11:48:52.071594 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 303/650] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:51 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:53.000120 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-4f4a7878-6731-4def-a5b6-051b8ae8391c req-48941db8-8133-4c21-8e0b-50cfd9fe8a95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9a7ce6-aede-493e-8e91-b35f4c51d954", "tag": "9e3c7542-e076-4781-be94-f9cf16cf7f57"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:53.008524 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-4f4a7878-6731-4def-a5b6-051b8ae8391c req-48941db8-8133-4c21-8e0b-50cfd9fe8a95 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:53.009093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-4f4a7878-6731-4def-a5b6-051b8ae8391c req-48941db8-8133-4c21-8e0b-50cfd9fe8a95 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:53.021285 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-4f4a7878-6731-4def-a5b6-051b8ae8391c req-48941db8-8133-4c21-8e0b-50cfd9fe8a95 service nova] Creating event network-changed:9e3c7542-e076-4781-be94-f9cf16cf7f57 for instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 on hv-cinder-84980 Jul 14 11:48:53.026510 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-4f4a7878-6731-4def-a5b6-051b8ae8391c req-48941db8-8133-4c21-8e0b-50cfd9fe8a95 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030553 Jul 14 11:48:53.027102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 348/651] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:48:53.088047 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-03ca3191-6b5a-41b0-98e8-fbe5eb903042 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:53.088700 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-03ca3191-6b5a-41b0-98e8-fbe5eb903042 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:53.096037 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-03ca3191-6b5a-41b0-98e8-fbe5eb903042 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:53.100298 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-03ca3191-6b5a-41b0-98e8-fbe5eb903042 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:53.100298 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-03ca3191-6b5a-41b0-98e8-fbe5eb903042 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:53.100298 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-03ca3191-6b5a-41b0-98e8-fbe5eb903042 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:53.303276 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-03ca3191-6b5a-41b0-98e8-fbe5eb903042 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:53.315826 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-03ca3191-6b5a-41b0-98e8-fbe5eb903042 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.231700 Jul 14 11:48:53.316331 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 304/652] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:53 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:54.113704 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-763534652", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce6397ea-e1d9-4c18-9185-6161e76618d7"}], "security_groups": [{"name": "tempest-securitygroup--1227377776"}], "key_name": "tempest-keypair-299555300", "user_data": "}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:54.217779 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.network.neutron [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] validate_networks() for [('ce6397ea-e1d9-4c18-9185-6161e76618d7', None, None, None, None, None)] {{(pid=124947) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:48:54.332670 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6555ed04-0e6e-4b7b-825c-8183d0c8d908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:54.338487 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6555ed04-0e6e-4b7b-825c-8183d0c8d908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:54.341978 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6555ed04-0e6e-4b7b-825c-8183d0c8d908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:54.342243 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6555ed04-0e6e-4b7b-825c-8183d0c8d908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:54.342942 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6555ed04-0e6e-4b7b-825c-8183d0c8d908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:54.343454 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6555ed04-0e6e-4b7b-825c-8183d0c8d908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:54.560081 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6555ed04-0e6e-4b7b-825c-8183d0c8d908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:54.569291 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6555ed04-0e6e-4b7b-825c-8183d0c8d908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1734 microversion: 2.1 time: 0.240679 Jul 14 11:48:54.569865 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 305/653] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:54 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1734 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:54.607163 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Flavor limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:48:54.607163 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Image limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:48:54.607402 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Flavor pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:48:54.607586 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Image pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:48:54.608003 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:48:54.616733 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:54.617197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:54.617984 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:54.618408 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:54.635517 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for project f274d555f5c746cc885394c699b3d767. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:48:54.639340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Getting quotas for user 8773c88f88614a9d903f667305a217e0 and project f274d555f5c746cc885394c699b3d767. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:48:54.650186 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Going to run 1 instances... {{(pid=124947) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:48:54.652512 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:48:54.793044 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-216864b5-0015-4ed1-ae5f-048554051e8b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.684634 Jul 14 11:48:54.798523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 349/654] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:48:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:48:54.808541 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c2873ff2-97e8-418f-85b8-07a89eb326ae tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:54.809181 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c2873ff2-97e8-418f-85b8-07a89eb326ae tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:54.865201 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-c2873ff2-97e8-418f-85b8-07a89eb326ae tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:54.869956 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c2873ff2-97e8-418f-85b8-07a89eb326ae tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1240 microversion: 2.1 time: 0.065533 Jul 14 11:48:54.870728 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 306/655] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:54 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:55.586941 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-cb0851a2-b296-4a98-b503-b0b9657d8c0d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:55.587565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-cb0851a2-b296-4a98-b503-b0b9657d8c0d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:55.593803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cb0851a2-b296-4a98-b503-b0b9657d8c0d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:55.594252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cb0851a2-b296-4a98-b503-b0b9657d8c0d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:55.595021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cb0851a2-b296-4a98-b503-b0b9657d8c0d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:55.595458 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cb0851a2-b296-4a98-b503-b0b9657d8c0d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:55.737198 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-cb0851a2-b296-4a98-b503-b0b9657d8c0d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:55.746015 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-cb0851a2-b296-4a98-b503-b0b9657d8c0d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1714 microversion: 2.1 time: 0.163150 Jul 14 11:48:55.746595 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 350/656] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:55 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:55.850708 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-2bce2c1f-8f0c-408f-b4d7-31949745615a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:55.851244 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-2bce2c1f-8f0c-408f-b4d7-31949745615a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:55.858727 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2bce2c1f-8f0c-408f-b4d7-31949745615a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:55.859172 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2bce2c1f-8f0c-408f-b4d7-31949745615a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:55.859937 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2bce2c1f-8f0c-408f-b4d7-31949745615a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:55.860403 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2bce2c1f-8f0c-408f-b4d7-31949745615a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:55.887156 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-4c227cde-59b7-40fd-aaa7-b5ce44fbbdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:55.887847 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-4c227cde-59b7-40fd-aaa7-b5ce44fbbdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:55.895059 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4c227cde-59b7-40fd-aaa7-b5ce44fbbdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:55.895711 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4c227cde-59b7-40fd-aaa7-b5ce44fbbdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:55.896763 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4c227cde-59b7-40fd-aaa7-b5ce44fbbdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:55.897289 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4c227cde-59b7-40fd-aaa7-b5ce44fbbdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:55.906453 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=100 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:55.949333 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-2bce2c1f-8f0c-408f-b4d7-31949745615a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] HTTP exception thrown: Cannot 'detach_volume' instance 1c667180-b390-45de-b693-7d59b8369eb6 while it is in vm_state rescued Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-2bce2c1f-8f0c-408f-b4d7-31949745615a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Request method failure captured: Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: DELETE /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments/6cc33005-cf36-4ae0-acff-c1f8069a90b7 HTTP/1.1 Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AHQD1ds0B25g5a12RFZgJ1X93Ad5kZKaW0a1WjTLos6WW0CS6889iadn7zLg9bxO6vFXCGcHydQ85EksLgMo8lXHCJEJA7JIza9eewxu56JoCts8WylfsrATjwEt9XaewZT3n2T3tUxjz2Qgf3sANPTml-AV6YyBO2MzgTVNMnGeHI Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 951609a482e34e93908057a68c5dc706 Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-954968877 Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:48:55.951211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:48:55.952800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/951609a482e34e93908057a68c5dc706"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_951609a482e34e93908057a68c5dc706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/951609a482e34e93908057a68c5dc706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/951609a482e34e93908057a68c5dc706"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:48:55.952800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-ServerRescueNegativeTestJSON-954968877 Jul 14 11:48:55.952800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 951609a482e34e93908057a68c5dc706 Jul 14 11:48:55.952800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-954968877 Jul 14 11:48:55.952800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-ServerRescueNegativeTestJSON-954968877-project Jul 14 11:48:55.952800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:48:55.952800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:48:55.952800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 7bf3f705e04640a2a5d9bedb71c6ccb5 Jul 14 11:48:55.952800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-ServerRescueNegativeTestJSON-954968877-project Jul 14 11:48:55.952800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:48:55.952800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Cannot 'detach_volume' instance 1c667180-b390-45de-b693-7d59b8369eb6 while it is in vm_state rescued Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'server_id': '1c667180-b390-45de-b693-7d59b8369eb6', 'id': '6cc33005-cf36-4ae0-acff-c1f8069a90b7'} Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c667180-b390-45de-b693-7d59b8369eb6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:48:55.953651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1c667180-b390-45de-b693-7d59b8369eb6 while it is in vm_state rescued Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1c667180-b390-45de-b693-7d59b8369eb6 while it is in vm_state rescued Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:48:55.955565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-2bce2c1f-8f0c-408f-b4d7-31949745615a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Returning 409 to user: Cannot 'detach_volume' instance 1c667180-b390-45de-b693-7d59b8369eb6 while it is in vm_state rescued {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:48:55.956927 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-2bce2c1f-8f0c-408f-b4d7-31949745615a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments/6cc33005-cf36-4ae0-acff-c1f8069a90b7" status: 409 len: 152 microversion: 2.1 time: 0.105971 Jul 14 11:48:55.957139 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 307/657] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 11:48:55 2022] DELETE /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments/6cc33005-cf36-4ae0-acff-c1f8069a90b7 => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 11:48:55.962022 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9d946e47-3d81-4dc5-89ce-f4b792f13035 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:55.962568 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9d946e47-3d81-4dc5-89ce-f4b792f13035 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:55.962769 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-4c227cde-59b7-40fd-aaa7-b5ce44fbbdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:55.972105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9d946e47-3d81-4dc5-89ce-f4b792f13035 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:55.972297 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-4c227cde-59b7-40fd-aaa7-b5ce44fbbdc1 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1244 microversion: 2.1 time: 0.088930 Jul 14 11:48:55.980073 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9d946e47-3d81-4dc5-89ce-f4b792f13035 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:55.980245 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 351/658] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:55 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:55.980346 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9d946e47-3d81-4dc5-89ce-f4b792f13035 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:55.980346 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9d946e47-3d81-4dc5-89ce-f4b792f13035 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:56.141056 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6ebfb9b4-dc77-4623-be31-e9f6e865cbba tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:48:56.142010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6ebfb9b4-dc77-4623-be31-e9f6e865cbba tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:56.143848 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:48:56.148836 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6ebfb9b4-dc77-4623-be31-e9f6e865cbba tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:56.149319 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6ebfb9b4-dc77-4623-be31-e9f6e865cbba tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:56.150084 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6ebfb9b4-dc77-4623-be31-e9f6e865cbba tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:56.150515 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6ebfb9b4-dc77-4623-be31-e9f6e865cbba tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:56.211547 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9d946e47-3d81-4dc5-89ce-f4b792f13035 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "POST /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/action" status: 202 len: 0 microversion: 2.1 time: 0.253039 Jul 14 11:48:56.212467 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 308/659] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 11:48:55 2022] POST /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:48:56.223567 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4656bceb-44d3-485a-9ef2-d9e248cad790 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:56.224277 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-4656bceb-44d3-485a-9ef2-d9e248cad790 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:56.232492 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4656bceb-44d3-485a-9ef2-d9e248cad790 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:56.232938 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4656bceb-44d3-485a-9ef2-d9e248cad790 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:56.237333 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4656bceb-44d3-485a-9ef2-d9e248cad790 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:56.237333 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4656bceb-44d3-485a-9ef2-d9e248cad790 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:56.370921 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-4656bceb-44d3-485a-9ef2-d9e248cad790 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:56.379209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-4656bceb-44d3-485a-9ef2-d9e248cad790 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1722 microversion: 2.1 time: 0.161567 Jul 14 11:48:56.379790 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 309/660] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:56 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:56.402351 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6ebfb9b4-dc77-4623-be31-e9f6e865cbba tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "POST /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/action" status: 202 len: 0 microversion: 2.1 time: 0.264724 Jul 14 11:48:56.402929 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 352/661] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 11:48:56 2022] POST /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:48:56.411526 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-cf054845-45e4-463b-85eb-af78300df15e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:56.412147 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-cf054845-45e4-463b-85eb-af78300df15e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:56.418309 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cf054845-45e4-463b-85eb-af78300df15e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:56.418759 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cf054845-45e4-463b-85eb-af78300df15e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:56.419527 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cf054845-45e4-463b-85eb-af78300df15e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:56.420314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cf054845-45e4-463b-85eb-af78300df15e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:56.559537 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-cf054845-45e4-463b-85eb-af78300df15e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:56.567481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-cf054845-45e4-463b-85eb-af78300df15e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1750 microversion: 2.1 time: 0.160194 Jul 14 11:48:56.568047 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 310/662] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:56 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:56.993364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a4038268-d84b-4693-8811-e907dbf0403f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:57.002360 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a4038268-d84b-4693-8811-e907dbf0403f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:57.007055 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a4038268-d84b-4693-8811-e907dbf0403f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:57.007628 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a4038268-d84b-4693-8811-e907dbf0403f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:57.008483 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a4038268-d84b-4693-8811-e907dbf0403f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:57.008919 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a4038268-d84b-4693-8811-e907dbf0403f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:57.075311 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a4038268-d84b-4693-8811-e907dbf0403f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:57.082835 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a4038268-d84b-4693-8811-e907dbf0403f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1300 microversion: 2.1 time: 0.094604 Jul 14 11:48:57.083404 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 353/663] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:56 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:57.399848 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-de588ff4-24bc-456f-bb3f-31edf00c957a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:57.401647 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-de588ff4-24bc-456f-bb3f-31edf00c957a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:57.411099 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-de588ff4-24bc-456f-bb3f-31edf00c957a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:57.411556 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-de588ff4-24bc-456f-bb3f-31edf00c957a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:57.412644 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-de588ff4-24bc-456f-bb3f-31edf00c957a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:57.412767 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-de588ff4-24bc-456f-bb3f-31edf00c957a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:57.584932 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c62a324b-474e-488c-b5ac-526667f54566 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:57.585506 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c62a324b-474e-488c-b5ac-526667f54566 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:57.592111 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c62a324b-474e-488c-b5ac-526667f54566 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:57.592562 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c62a324b-474e-488c-b5ac-526667f54566 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:57.593412 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c62a324b-474e-488c-b5ac-526667f54566 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:57.593855 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c62a324b-474e-488c-b5ac-526667f54566 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:57.630950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-de588ff4-24bc-456f-bb3f-31edf00c957a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:57.642602 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-de588ff4-24bc-456f-bb3f-31edf00c957a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1722 microversion: 2.1 time: 0.249169 Jul 14 11:48:57.643311 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 311/664] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:57 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:57.764884 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c62a324b-474e-488c-b5ac-526667f54566 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:57.774202 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c62a324b-474e-488c-b5ac-526667f54566 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1750 microversion: 2.1 time: 0.193113 Jul 14 11:48:57.774795 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 354/665] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:57 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1750 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:58.100027 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-fa473227-58da-4412-a386-e38dee3694c4 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:58.100690 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-fa473227-58da-4412-a386-e38dee3694c4 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:58.109564 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fa473227-58da-4412-a386-e38dee3694c4 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:58.110040 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fa473227-58da-4412-a386-e38dee3694c4 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:58.110831 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fa473227-58da-4412-a386-e38dee3694c4 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:58.111280 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fa473227-58da-4412-a386-e38dee3694c4 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:58.328085 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-fa473227-58da-4412-a386-e38dee3694c4 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:58.336208 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-fa473227-58da-4412-a386-e38dee3694c4 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1366 microversion: 2.1 time: 0.240129 Jul 14 11:48:58.336928 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 312/666] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:58 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:58.660529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-bb04cd9c-af4c-402e-8528-e57fe5284ddd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:58.661067 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-bb04cd9c-af4c-402e-8528-e57fe5284ddd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:58.668089 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bb04cd9c-af4c-402e-8528-e57fe5284ddd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:58.668529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bb04cd9c-af4c-402e-8528-e57fe5284ddd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:58.669317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bb04cd9c-af4c-402e-8528-e57fe5284ddd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:58.669748 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bb04cd9c-af4c-402e-8528-e57fe5284ddd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:58.793735 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-275b593d-594d-4efe-93ee-6fea19fe2c79 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:58.794735 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-275b593d-594d-4efe-93ee-6fea19fe2c79 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:58.803536 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-bb04cd9c-af4c-402e-8528-e57fe5284ddd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:58.808801 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-275b593d-594d-4efe-93ee-6fea19fe2c79 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:58.809286 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-275b593d-594d-4efe-93ee-6fea19fe2c79 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:58.810103 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-275b593d-594d-4efe-93ee-6fea19fe2c79 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:58.810540 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-275b593d-594d-4efe-93ee-6fea19fe2c79 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:58.813594 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-bb04cd9c-af4c-402e-8528-e57fe5284ddd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1722 microversion: 2.1 time: 0.156833 Jul 14 11:48:58.814185 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 355/667] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:58 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:58.958657 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-275b593d-594d-4efe-93ee-6fea19fe2c79 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:58.967246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-275b593d-594d-4efe-93ee-6fea19fe2c79 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1755 microversion: 2.1 time: 0.179262 Jul 14 11:48:58.967809 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 313/668] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:58 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:48:59.354027 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-790ba99d-0c88-4046-84db-ad1e3f307839 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:59.354640 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-790ba99d-0c88-4046-84db-ad1e3f307839 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:59.360672 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-790ba99d-0c88-4046-84db-ad1e3f307839 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:59.361124 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-790ba99d-0c88-4046-84db-ad1e3f307839 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:59.361912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-790ba99d-0c88-4046-84db-ad1e3f307839 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:59.362351 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-790ba99d-0c88-4046-84db-ad1e3f307839 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:59.488744 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-790ba99d-0c88-4046-84db-ad1e3f307839 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:48:59.496143 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-790ba99d-0c88-4046-84db-ad1e3f307839 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1366 microversion: 2.1 time: 0.146128 Jul 14 11:48:59.496720 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 356/669] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:59 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:48:59.830813 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-609b170a-d5d5-45f3-a368-06217a1da22d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:59.831439 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-609b170a-d5d5-45f3-a368-06217a1da22d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:59.838200 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-609b170a-d5d5-45f3-a368-06217a1da22d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:59.838711 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-609b170a-d5d5-45f3-a368-06217a1da22d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:59.839494 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-609b170a-d5d5-45f3-a368-06217a1da22d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:59.839926 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-609b170a-d5d5-45f3-a368-06217a1da22d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:59.984578 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f72636b7-212d-46b2-ab92-a9aec2223b17 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:48:59.985342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f72636b7-212d-46b2-ab92-a9aec2223b17 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:48:59.992259 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f72636b7-212d-46b2-ab92-a9aec2223b17 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:59.992707 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f72636b7-212d-46b2-ab92-a9aec2223b17 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:48:59.993519 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f72636b7-212d-46b2-ab92-a9aec2223b17 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:48:59.993954 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f72636b7-212d-46b2-ab92-a9aec2223b17 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:00.152296 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f72636b7-212d-46b2-ab92-a9aec2223b17 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:00.160332 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f72636b7-212d-46b2-ab92-a9aec2223b17 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1755 microversion: 2.1 time: 0.179716 Jul 14 11:49:00.170291 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 357/670] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:59 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:49:00.196378 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-cacd8d27-43fa-42ab-aa5b-5306710a5655 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:49:00.196909 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-cacd8d27-43fa-42ab-aa5b-5306710a5655 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:00.203414 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cacd8d27-43fa-42ab-aa5b-5306710a5655 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:00.203853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cacd8d27-43fa-42ab-aa5b-5306710a5655 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:00.204616 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cacd8d27-43fa-42ab-aa5b-5306710a5655 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:00.205039 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cacd8d27-43fa-42ab-aa5b-5306710a5655 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:00.224687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-609b170a-d5d5-45f3-a368-06217a1da22d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:00.228621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-cacd8d27-43fa-42ab-aa5b-5306710a5655 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lazy-loading 'flavor' on Instance uuid ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:49:00.235564 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-609b170a-d5d5-45f3-a368-06217a1da22d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1722 microversion: 2.1 time: 0.408523 Jul 14 11:49:00.246133 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 314/671] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:48:59 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1722 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:00.493396 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-cacd8d27-43fa-42ab-aa5b-5306710a5655 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "POST /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1/action" status: 202 len: 0 microversion: 2.1 time: 0.300468 Jul 14 11:49:00.494082 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 358/672] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 11:49:00 2022] POST /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:49:00.502432 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9a222da0-bbf6-42f8-9e92-001925d91c8c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:00.503362 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9a222da0-bbf6-42f8-9e92-001925d91c8c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:00.513810 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9a222da0-bbf6-42f8-9e92-001925d91c8c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:00.514638 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9a222da0-bbf6-42f8-9e92-001925d91c8c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:00.515658 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9a222da0-bbf6-42f8-9e92-001925d91c8c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:00.516307 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9a222da0-bbf6-42f8-9e92-001925d91c8c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:00.519354 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-85d26fb0-353f-463d-ad7e-4fe7bb77cf4b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:00.520332 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-85d26fb0-353f-463d-ad7e-4fe7bb77cf4b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:00.529750 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85d26fb0-353f-463d-ad7e-4fe7bb77cf4b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:00.530311 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85d26fb0-353f-463d-ad7e-4fe7bb77cf4b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:00.531235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85d26fb0-353f-463d-ad7e-4fe7bb77cf4b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:00.531760 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85d26fb0-353f-463d-ad7e-4fe7bb77cf4b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:00.688049 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-85d26fb0-353f-463d-ad7e-4fe7bb77cf4b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:00.696506 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-85d26fb0-353f-463d-ad7e-4fe7bb77cf4b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1366 microversion: 2.1 time: 0.184869 Jul 14 11:49:00.697841 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 359/673] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:00 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:00.702327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-ba318402-dee0-4da4-a385-0764e6910db7 req-d34b567a-4c0f-4c16-9de6-5e610ab69af0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046cf283-3c75-404b-b0a5-47ff4e2b9b38", "tag": "2bf88cae-cdc5-4206-8a26-2e2997ddefac"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:49:00.718693 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-ba318402-dee0-4da4-a385-0764e6910db7 req-d34b567a-4c0f-4c16-9de6-5e610ab69af0 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:00.718693 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-ba318402-dee0-4da4-a385-0764e6910db7 req-d34b567a-4c0f-4c16-9de6-5e610ab69af0 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:00.747665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-ba318402-dee0-4da4-a385-0764e6910db7 req-d34b567a-4c0f-4c16-9de6-5e610ab69af0 service nova] Creating event network-changed:2bf88cae-cdc5-4206-8a26-2e2997ddefac for instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 on hv-cinder-84980 Jul 14 11:49:00.753494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-ba318402-dee0-4da4-a385-0764e6910db7 req-d34b567a-4c0f-4c16-9de6-5e610ab69af0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054339 Jul 14 11:49:00.754592 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 360/674] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:00.854495 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9a222da0-bbf6-42f8-9e92-001925d91c8c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:00.862603 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9a222da0-bbf6-42f8-9e92-001925d91c8c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.363939 Jul 14 11:49:00.863453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 315/675] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:00 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:01.179573 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-71973ed4-ec3b-4e1a-a86a-59ea75cbe6ff tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:01.180316 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-71973ed4-ec3b-4e1a-a86a-59ea75cbe6ff tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:01.186791 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-71973ed4-ec3b-4e1a-a86a-59ea75cbe6ff tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:01.187239 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-71973ed4-ec3b-4e1a-a86a-59ea75cbe6ff tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:01.188028 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-71973ed4-ec3b-4e1a-a86a-59ea75cbe6ff tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:01.188679 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-71973ed4-ec3b-4e1a-a86a-59ea75cbe6ff tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:01.253866 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ce1b5018-9115-496e-a50a-9a3aeae00191 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:01.254493 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ce1b5018-9115-496e-a50a-9a3aeae00191 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:01.261899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ce1b5018-9115-496e-a50a-9a3aeae00191 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:01.262349 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ce1b5018-9115-496e-a50a-9a3aeae00191 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:01.263128 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ce1b5018-9115-496e-a50a-9a3aeae00191 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:01.263767 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ce1b5018-9115-496e-a50a-9a3aeae00191 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:01.346832 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-71973ed4-ec3b-4e1a-a86a-59ea75cbe6ff tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:01.356056 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-71973ed4-ec3b-4e1a-a86a-59ea75cbe6ff tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1755 microversion: 2.1 time: 0.181663 Jul 14 11:49:01.356960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 361/676] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:01 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:01.529818 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ce1b5018-9115-496e-a50a-9a3aeae00191 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:01.538561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ce1b5018-9115-496e-a50a-9a3aeae00191 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1728 microversion: 2.1 time: 0.288525 Jul 14 11:49:01.539154 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 316/677] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:01 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1728 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:49:01.556098 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d747891d-819a-4215-950d-4fcffd4f16d0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:01.556708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d747891d-819a-4215-950d-4fcffd4f16d0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:01.565362 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d747891d-819a-4215-950d-4fcffd4f16d0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:01.569258 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d747891d-819a-4215-950d-4fcffd4f16d0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:01.569258 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d747891d-819a-4215-950d-4fcffd4f16d0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:01.569258 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d747891d-819a-4215-950d-4fcffd4f16d0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:01.650462 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d747891d-819a-4215-950d-4fcffd4f16d0 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098155 Jul 14 11:49:01.655032 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 362/678] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jul 14 11:49:01 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:01.716121 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4e45c1c4-aa35-4276-9648-5f64983ff590 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:01.717934 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-4e45c1c4-aa35-4276-9648-5f64983ff590 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:01.730425 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4e45c1c4-aa35-4276-9648-5f64983ff590 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:01.733476 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4e45c1c4-aa35-4276-9648-5f64983ff590 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:01.734420 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4e45c1c4-aa35-4276-9648-5f64983ff590 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:01.736793 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4e45c1c4-aa35-4276-9648-5f64983ff590 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:01.880199 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3419f60a-0374-4d6d-b300-d1a25ddda369 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:01.881516 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3419f60a-0374-4d6d-b300-d1a25ddda369 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:01.888552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3419f60a-0374-4d6d-b300-d1a25ddda369 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:01.889107 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3419f60a-0374-4d6d-b300-d1a25ddda369 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:01.889997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3419f60a-0374-4d6d-b300-d1a25ddda369 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:01.890507 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3419f60a-0374-4d6d-b300-d1a25ddda369 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:01.954112 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-4e45c1c4-aa35-4276-9648-5f64983ff590 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:01.961880 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-4e45c1c4-aa35-4276-9648-5f64983ff590 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1366 microversion: 2.1 time: 0.252355 Jul 14 11:49:01.968052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 317/679] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:01 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:02.192846 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3419f60a-0374-4d6d-b300-d1a25ddda369 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:02.201613 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3419f60a-0374-4d6d-b300-d1a25ddda369 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.325370 Jul 14 11:49:02.202188 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 363/680] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:01 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:49:02.374051 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-fd325e8f-346d-4441-b5d7-1efbed49765e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:02.374678 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-fd325e8f-346d-4441-b5d7-1efbed49765e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:02.380846 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fd325e8f-346d-4441-b5d7-1efbed49765e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:02.381318 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fd325e8f-346d-4441-b5d7-1efbed49765e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:02.382093 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fd325e8f-346d-4441-b5d7-1efbed49765e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:02.382534 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fd325e8f-346d-4441-b5d7-1efbed49765e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:02.525432 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-fd325e8f-346d-4441-b5d7-1efbed49765e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:02.533960 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-fd325e8f-346d-4441-b5d7-1efbed49765e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1755 microversion: 2.1 time: 0.164658 Jul 14 11:49:02.534525 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 318/681] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:02 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:02.945932 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-7e1be18c-fe3f-4530-bd59-d56c72028033 req-e7547369-2961-4b8c-844c-bfcfd3981956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c667180-b390-45de-b693-7d59b8369eb6", "tag": "941e85d3-a14c-4664-99a5-c7fce2347e18"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:49:02.954555 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-7e1be18c-fe3f-4530-bd59-d56c72028033 req-e7547369-2961-4b8c-844c-bfcfd3981956 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:02.954999 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-7e1be18c-fe3f-4530-bd59-d56c72028033 req-e7547369-2961-4b8c-844c-bfcfd3981956 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:02.966831 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-7e1be18c-fe3f-4530-bd59-d56c72028033 req-e7547369-2961-4b8c-844c-bfcfd3981956 service nova] Creating event network-changed:941e85d3-a14c-4664-99a5-c7fce2347e18 for instance 1c667180-b390-45de-b693-7d59b8369eb6 on hv-cinder-84980 Jul 14 11:49:02.978620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-be454b42-8031-48e9-96b3-5eccd65380e3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:02.979238 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-be454b42-8031-48e9-96b3-5eccd65380e3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:02.981657 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:02.983028 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-7e1be18c-fe3f-4530-bd59-d56c72028033 req-e7547369-2961-4b8c-844c-bfcfd3981956 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041039 Jul 14 11:49:02.984196 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 364/682] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:49:02.986778 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-be454b42-8031-48e9-96b3-5eccd65380e3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:02.987232 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-be454b42-8031-48e9-96b3-5eccd65380e3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:02.988013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-be454b42-8031-48e9-96b3-5eccd65380e3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:02.988451 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-be454b42-8031-48e9-96b3-5eccd65380e3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:03.127760 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-be454b42-8031-48e9-96b3-5eccd65380e3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:03.130096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:03.136076 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-be454b42-8031-48e9-96b3-5eccd65380e3 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1366 microversion: 2.1 time: 0.161325 Jul 14 11:49:03.136797 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 319/683] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:02 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:03.220134 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3209d019-f68c-433b-aa53-6bbf509dd637 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:03.220847 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3209d019-f68c-433b-aa53-6bbf509dd637 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:03.228570 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3209d019-f68c-433b-aa53-6bbf509dd637 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:03.229554 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3209d019-f68c-433b-aa53-6bbf509dd637 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:03.230342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3209d019-f68c-433b-aa53-6bbf509dd637 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:03.230781 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3209d019-f68c-433b-aa53-6bbf509dd637 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:03.385197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3209d019-f68c-433b-aa53-6bbf509dd637 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:03.393775 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3209d019-f68c-433b-aa53-6bbf509dd637 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.178524 Jul 14 11:49:03.394759 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 365/684] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:03 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:03.551216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6991eb03-7961-4989-baef-b46f89f4cb39 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:03.551841 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6991eb03-7961-4989-baef-b46f89f4cb39 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:03.558786 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6991eb03-7961-4989-baef-b46f89f4cb39 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:03.559243 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6991eb03-7961-4989-baef-b46f89f4cb39 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:03.560022 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6991eb03-7961-4989-baef-b46f89f4cb39 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:03.560461 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6991eb03-7961-4989-baef-b46f89f4cb39 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:03.814249 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6991eb03-7961-4989-baef-b46f89f4cb39 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:03.823582 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6991eb03-7961-4989-baef-b46f89f4cb39 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1755 microversion: 2.1 time: 0.275666 Jul 14 11:49:03.824356 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 320/685] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:03 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1755 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:04.153072 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-87f17dbd-e4f2-46b1-8b5b-b270cf493186 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:04.153657 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-87f17dbd-e4f2-46b1-8b5b-b270cf493186 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:04.159685 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-87f17dbd-e4f2-46b1-8b5b-b270cf493186 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:04.160111 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-87f17dbd-e4f2-46b1-8b5b-b270cf493186 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:04.160872 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-87f17dbd-e4f2-46b1-8b5b-b270cf493186 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:04.161342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-87f17dbd-e4f2-46b1-8b5b-b270cf493186 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:04.176165 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:04.293726 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-87f17dbd-e4f2-46b1-8b5b-b270cf493186 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:04.301047 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-87f17dbd-e4f2-46b1-8b5b-b270cf493186 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1366 microversion: 2.1 time: 0.151879 Jul 14 11:49:04.301682 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 366/686] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:04 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:04.411509 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6e7cf3a2-9b75-4333-ace5-66e34dd7e8a1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:04.412032 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6e7cf3a2-9b75-4333-ace5-66e34dd7e8a1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:04.418638 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6e7cf3a2-9b75-4333-ace5-66e34dd7e8a1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:04.419085 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6e7cf3a2-9b75-4333-ace5-66e34dd7e8a1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:04.419845 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6e7cf3a2-9b75-4333-ace5-66e34dd7e8a1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:04.420279 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6e7cf3a2-9b75-4333-ace5-66e34dd7e8a1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:04.564157 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6e7cf3a2-9b75-4333-ace5-66e34dd7e8a1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:04.571742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6e7cf3a2-9b75-4333-ace5-66e34dd7e8a1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.164175 Jul 14 11:49:04.572311 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 321/687] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:04 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:04.840771 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-90c3657e-767b-4dd8-a077-2125c6e0989d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:04.841419 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-90c3657e-767b-4dd8-a077-2125c6e0989d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:04.843230 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:04.843895 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=6 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:04.850521 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90c3657e-767b-4dd8-a077-2125c6e0989d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:04.850975 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90c3657e-767b-4dd8-a077-2125c6e0989d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:04.851758 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90c3657e-767b-4dd8-a077-2125c6e0989d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:04.852196 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90c3657e-767b-4dd8-a077-2125c6e0989d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:05.002344 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-845f6363-e144-4404-9c89-fdc86ca3cadd req-17e68709-d21d-4695-a7fe-ce76b29bcd60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c667180-b390-45de-b693-7d59b8369eb6", "tag": "941e85d3-a14c-4664-99a5-c7fce2347e18"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:49:05.006188 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=6 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:05.011053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-90c3657e-767b-4dd8-a077-2125c6e0989d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:05.012070 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-845f6363-e144-4404-9c89-fdc86ca3cadd req-17e68709-d21d-4695-a7fe-ce76b29bcd60 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:05.012522 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-845f6363-e144-4404-9c89-fdc86ca3cadd req-17e68709-d21d-4695-a7fe-ce76b29bcd60 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:05.021190 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-90c3657e-767b-4dd8-a077-2125c6e0989d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1755 microversion: 2.1 time: 0.184227 Jul 14 11:49:05.022275 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 367/688] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:04 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:05.024502 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-845f6363-e144-4404-9c89-fdc86ca3cadd req-17e68709-d21d-4695-a7fe-ce76b29bcd60 service nova] Creating event network-changed:941e85d3-a14c-4664-99a5-c7fce2347e18 for instance 1c667180-b390-45de-b693-7d59b8369eb6 on hv-cinder-84980 Jul 14 11:49:05.030652 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-845f6363-e144-4404-9c89-fdc86ca3cadd req-17e68709-d21d-4695-a7fe-ce76b29bcd60 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032007 Jul 14 11:49:05.031241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 322/689] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:49:05.318817 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-aa7892e6-60f2-40ce-8595-17aad258479c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:05.320331 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-aa7892e6-60f2-40ce-8595-17aad258479c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:05.328418 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aa7892e6-60f2-40ce-8595-17aad258479c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:05.328865 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aa7892e6-60f2-40ce-8595-17aad258479c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:05.329664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aa7892e6-60f2-40ce-8595-17aad258479c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:05.330253 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aa7892e6-60f2-40ce-8595-17aad258479c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:05.473898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-aa7892e6-60f2-40ce-8595-17aad258479c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:05.481838 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-aa7892e6-60f2-40ce-8595-17aad258479c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1366 microversion: 2.1 time: 0.167040 Jul 14 11:49:05.482947 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 368/690] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:05 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:05.589960 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-981d6459-0176-48be-8719-500a36aa322e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:05.590718 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-981d6459-0176-48be-8719-500a36aa322e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:05.597103 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-981d6459-0176-48be-8719-500a36aa322e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:05.597590 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-981d6459-0176-48be-8719-500a36aa322e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:05.599188 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-981d6459-0176-48be-8719-500a36aa322e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:05.599188 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-981d6459-0176-48be-8719-500a36aa322e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:05.733755 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-981d6459-0176-48be-8719-500a36aa322e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:05.741438 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-981d6459-0176-48be-8719-500a36aa322e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.156924 Jul 14 11:49:05.742008 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 323/691] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:05 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:06.042120 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-229727f4-8ebd-428d-8d8e-0c7838bb2354 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:06.042727 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-229727f4-8ebd-428d-8d8e-0c7838bb2354 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:06.049019 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-229727f4-8ebd-428d-8d8e-0c7838bb2354 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:06.049488 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-229727f4-8ebd-428d-8d8e-0c7838bb2354 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:06.053490 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-229727f4-8ebd-428d-8d8e-0c7838bb2354 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:06.053490 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-229727f4-8ebd-428d-8d8e-0c7838bb2354 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:06.191838 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-229727f4-8ebd-428d-8d8e-0c7838bb2354 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:06.200232 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-229727f4-8ebd-428d-8d8e-0c7838bb2354 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1755 microversion: 2.1 time: 0.161980 Jul 14 11:49:06.200814 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 369/692] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:06 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:06.499167 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-23c1f125-6de3-42fe-bedf-006362ea2ee0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:06.499701 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-23c1f125-6de3-42fe-bedf-006362ea2ee0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:06.505814 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-23c1f125-6de3-42fe-bedf-006362ea2ee0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:06.506262 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-23c1f125-6de3-42fe-bedf-006362ea2ee0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:06.507020 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-23c1f125-6de3-42fe-bedf-006362ea2ee0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:06.507456 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-23c1f125-6de3-42fe-bedf-006362ea2ee0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:06.638931 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-23c1f125-6de3-42fe-bedf-006362ea2ee0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:06.646529 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-23c1f125-6de3-42fe-bedf-006362ea2ee0 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1366 microversion: 2.1 time: 0.151806 Jul 14 11:49:06.647100 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 324/693] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:06 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:06.758834 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ad7e8b21-fce3-480a-ab07-5f63f282638a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:06.759455 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ad7e8b21-fce3-480a-ab07-5f63f282638a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:06.766580 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ad7e8b21-fce3-480a-ab07-5f63f282638a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:06.767032 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ad7e8b21-fce3-480a-ab07-5f63f282638a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:06.767795 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ad7e8b21-fce3-480a-ab07-5f63f282638a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:06.768231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ad7e8b21-fce3-480a-ab07-5f63f282638a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:06.901596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ad7e8b21-fce3-480a-ab07-5f63f282638a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:06.909145 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ad7e8b21-fce3-480a-ab07-5f63f282638a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.154194 Jul 14 11:49:06.909739 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 370/694] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:06 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:07.217904 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c662867d-eeb5-4007-acde-14728ba78690 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:07.218543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c662867d-eeb5-4007-acde-14728ba78690 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:07.224573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c662867d-eeb5-4007-acde-14728ba78690 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:07.225012 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c662867d-eeb5-4007-acde-14728ba78690 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:07.225804 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c662867d-eeb5-4007-acde-14728ba78690 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:07.226238 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c662867d-eeb5-4007-acde-14728ba78690 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:07.312585 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-5e83179e-cc4e-4ce2-814b-147eeb107df5 req-2d58dc17-6f18-4025-9f40-e98cd6e19185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046cf283-3c75-404b-b0a5-47ff4e2b9b38", "name": "network-vif-plugged", "status": "completed", "tag": "2bf88cae-cdc5-4206-8a26-2e2997ddefac"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:49:07.328806 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-5e83179e-cc4e-4ce2-814b-147eeb107df5 req-2d58dc17-6f18-4025-9f40-e98cd6e19185 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:07.328806 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-5e83179e-cc4e-4ce2-814b-147eeb107df5 req-2d58dc17-6f18-4025-9f40-e98cd6e19185 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:07.335887 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-5e83179e-cc4e-4ce2-814b-147eeb107df5 req-2d58dc17-6f18-4025-9f40-e98cd6e19185 service nova] Creating event network-vif-plugged:2bf88cae-cdc5-4206-8a26-2e2997ddefac for instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 on hv-cinder-84980 Jul 14 11:49:07.342141 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-5e83179e-cc4e-4ce2-814b-147eeb107df5 req-2d58dc17-6f18-4025-9f40-e98cd6e19185 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033228 Jul 14 11:49:07.342750 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 371/695] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:07.374570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-c662867d-eeb5-4007-acde-14728ba78690 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:07.384065 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c662867d-eeb5-4007-acde-14728ba78690 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1755 microversion: 2.1 time: 0.170519 Jul 14 11:49:07.384627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 325/696] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:07 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:07.664401 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-90d8a4e2-1e54-4a84-95bc-c92a30765fd2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:07.665027 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-90d8a4e2-1e54-4a84-95bc-c92a30765fd2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:07.672741 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90d8a4e2-1e54-4a84-95bc-c92a30765fd2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:07.673215 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90d8a4e2-1e54-4a84-95bc-c92a30765fd2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:07.674000 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90d8a4e2-1e54-4a84-95bc-c92a30765fd2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:07.674436 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90d8a4e2-1e54-4a84-95bc-c92a30765fd2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:07.819548 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-90d8a4e2-1e54-4a84-95bc-c92a30765fd2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:07.827728 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-90d8a4e2-1e54-4a84-95bc-c92a30765fd2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1366 microversion: 2.1 time: 0.167856 Jul 14 11:49:07.828297 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 372/697] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:07 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:07.927232 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-cc2c1da7-6b54-453e-8213-e14b3f4307d9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:07.927857 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-cc2c1da7-6b54-453e-8213-e14b3f4307d9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:07.934838 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cc2c1da7-6b54-453e-8213-e14b3f4307d9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:07.935282 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cc2c1da7-6b54-453e-8213-e14b3f4307d9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:07.936037 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cc2c1da7-6b54-453e-8213-e14b3f4307d9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:07.936468 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cc2c1da7-6b54-453e-8213-e14b3f4307d9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:08.069692 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-cc2c1da7-6b54-453e-8213-e14b3f4307d9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:08.078331 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-cc2c1da7-6b54-453e-8213-e14b3f4307d9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.155319 Jul 14 11:49:08.078904 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 326/698] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:07 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:08.401607 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-0b62596d-1072-4174-83e4-2717a84f9824 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:08.402238 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-0b62596d-1072-4174-83e4-2717a84f9824 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:08.408296 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0b62596d-1072-4174-83e4-2717a84f9824 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:08.408745 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0b62596d-1072-4174-83e4-2717a84f9824 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:08.409542 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0b62596d-1072-4174-83e4-2717a84f9824 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:08.409988 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0b62596d-1072-4174-83e4-2717a84f9824 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:08.551617 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-0b62596d-1072-4174-83e4-2717a84f9824 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:08.559762 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-0b62596d-1072-4174-83e4-2717a84f9824 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1755 microversion: 2.1 time: 0.162387 Jul 14 11:49:08.560336 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 373/699] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:08 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:08.844254 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-50d1c9be-11cf-45fe-b1d6-243631cadb79 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:08.844856 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-50d1c9be-11cf-45fe-b1d6-243631cadb79 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:08.850941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50d1c9be-11cf-45fe-b1d6-243631cadb79 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:08.851383 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50d1c9be-11cf-45fe-b1d6-243631cadb79 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:08.852138 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50d1c9be-11cf-45fe-b1d6-243631cadb79 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:08.852569 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-50d1c9be-11cf-45fe-b1d6-243631cadb79 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:08.979475 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-50d1c9be-11cf-45fe-b1d6-243631cadb79 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:08.986777 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-50d1c9be-11cf-45fe-b1d6-243631cadb79 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1366 microversion: 2.1 time: 0.146336 Jul 14 11:49:08.987342 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 327/700] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:08 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:09.095442 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2dd1d177-2435-4617-bc71-46f862def700 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:09.095978 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2dd1d177-2435-4617-bc71-46f862def700 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:09.102627 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2dd1d177-2435-4617-bc71-46f862def700 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:09.103129 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2dd1d177-2435-4617-bc71-46f862def700 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:09.103899 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2dd1d177-2435-4617-bc71-46f862def700 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:09.104366 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2dd1d177-2435-4617-bc71-46f862def700 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:09.241011 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2dd1d177-2435-4617-bc71-46f862def700 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:09.248524 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2dd1d177-2435-4617-bc71-46f862def700 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.157017 Jul 14 11:49:09.249095 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 374/701] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:09 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:09.576453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-109ab9b7-e8df-4ea5-926e-b21a9396fc04 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:09.577069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-109ab9b7-e8df-4ea5-926e-b21a9396fc04 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:09.583186 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-109ab9b7-e8df-4ea5-926e-b21a9396fc04 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:09.583642 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-109ab9b7-e8df-4ea5-926e-b21a9396fc04 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:09.584435 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-109ab9b7-e8df-4ea5-926e-b21a9396fc04 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:09.584892 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-109ab9b7-e8df-4ea5-926e-b21a9396fc04 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:09.726167 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-109ab9b7-e8df-4ea5-926e-b21a9396fc04 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:09.734749 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-109ab9b7-e8df-4ea5-926e-b21a9396fc04 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1755 microversion: 2.1 time: 0.162786 Jul 14 11:49:09.735312 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 328/702] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:09 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:10.003372 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-754b10d7-b96f-466e-820b-aa5216b27a31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:10.003895 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-754b10d7-b96f-466e-820b-aa5216b27a31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:10.009968 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-754b10d7-b96f-466e-820b-aa5216b27a31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:10.010926 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-754b10d7-b96f-466e-820b-aa5216b27a31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:10.011683 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-754b10d7-b96f-466e-820b-aa5216b27a31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:10.012113 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-754b10d7-b96f-466e-820b-aa5216b27a31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:10.140010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-754b10d7-b96f-466e-820b-aa5216b27a31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:10.147370 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-754b10d7-b96f-466e-820b-aa5216b27a31 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1366 microversion: 2.1 time: 0.147997 Jul 14 11:49:10.148189 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 375/703] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:09 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:10.265995 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b3cc732b-72bd-4d20-8818-aef6d09ee5b4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:10.266622 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b3cc732b-72bd-4d20-8818-aef6d09ee5b4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:10.273527 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b3cc732b-72bd-4d20-8818-aef6d09ee5b4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:10.273978 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b3cc732b-72bd-4d20-8818-aef6d09ee5b4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:10.274745 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b3cc732b-72bd-4d20-8818-aef6d09ee5b4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:10.275183 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b3cc732b-72bd-4d20-8818-aef6d09ee5b4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:10.404902 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b3cc732b-72bd-4d20-8818-aef6d09ee5b4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:10.412336 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b3cc732b-72bd-4d20-8818-aef6d09ee5b4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.150276 Jul 14 11:49:10.412896 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 329/704] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:10 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:10.751232 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-e24fc486-fd19-48fe-8308-4161db4a7ec8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:10.751751 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-e24fc486-fd19-48fe-8308-4161db4a7ec8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:10.758062 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e24fc486-fd19-48fe-8308-4161db4a7ec8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:10.758508 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e24fc486-fd19-48fe-8308-4161db4a7ec8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:10.759278 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e24fc486-fd19-48fe-8308-4161db4a7ec8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:10.759712 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e24fc486-fd19-48fe-8308-4161db4a7ec8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:10.908972 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e24fc486-fd19-48fe-8308-4161db4a7ec8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:10.917869 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-e24fc486-fd19-48fe-8308-4161db4a7ec8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1755 microversion: 2.1 time: 0.170652 Jul 14 11:49:10.918434 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 376/705] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:10 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:11.164726 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4fca22f9-f34b-43f6-9979-721e1afb4a29 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:11.165385 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-4fca22f9-f34b-43f6-9979-721e1afb4a29 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:11.172064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4fca22f9-f34b-43f6-9979-721e1afb4a29 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:11.174508 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4fca22f9-f34b-43f6-9979-721e1afb4a29 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:11.174508 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4fca22f9-f34b-43f6-9979-721e1afb4a29 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:11.174508 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4fca22f9-f34b-43f6-9979-721e1afb4a29 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:11.429779 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a6e3ed23-5c88-4fff-ae92-3aeebe2a9630 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:11.430228 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a6e3ed23-5c88-4fff-ae92-3aeebe2a9630 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:11.431775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-4fca22f9-f34b-43f6-9979-721e1afb4a29 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:11.436553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a6e3ed23-5c88-4fff-ae92-3aeebe2a9630 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:11.437001 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a6e3ed23-5c88-4fff-ae92-3aeebe2a9630 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:11.437817 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a6e3ed23-5c88-4fff-ae92-3aeebe2a9630 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:11.438260 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a6e3ed23-5c88-4fff-ae92-3aeebe2a9630 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:11.441087 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-4fca22f9-f34b-43f6-9979-721e1afb4a29 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1556 microversion: 2.1 time: 0.280246 Jul 14 11:49:11.441693 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 330/706] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:11 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1556 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:11.457937 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a80580a3-8f04-4e4d-a310-5746714ed42f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:11.458761 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a80580a3-8f04-4e4d-a310-5746714ed42f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:11.466041 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a80580a3-8f04-4e4d-a310-5746714ed42f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:11.466493 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a80580a3-8f04-4e4d-a310-5746714ed42f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:11.467261 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a80580a3-8f04-4e4d-a310-5746714ed42f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:11.467692 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a80580a3-8f04-4e4d-a310-5746714ed42f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:11.546387 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a80580a3-8f04-4e4d-a310-5746714ed42f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092042 Jul 14 11:49:11.547021 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 331/707] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jul 14 11:49:11 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:49:11.577958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a6e3ed23-5c88-4fff-ae92-3aeebe2a9630 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:11.585406 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a6e3ed23-5c88-4fff-ae92-3aeebe2a9630 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.159921 Jul 14 11:49:11.585992 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 377/708] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:11 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:49:11.935834 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3457d96c-ea98-4afa-acbc-b59bbeed64a8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:11.936492 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3457d96c-ea98-4afa-acbc-b59bbeed64a8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:11.942961 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3457d96c-ea98-4afa-acbc-b59bbeed64a8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:11.943411 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3457d96c-ea98-4afa-acbc-b59bbeed64a8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:11.944204 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3457d96c-ea98-4afa-acbc-b59bbeed64a8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:11.944645 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3457d96c-ea98-4afa-acbc-b59bbeed64a8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:12.325371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-3457d96c-ea98-4afa-acbc-b59bbeed64a8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:12.333412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3457d96c-ea98-4afa-acbc-b59bbeed64a8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1755 microversion: 2.1 time: 0.401964 Jul 14 11:49:12.337824 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 332/709] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:11 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1755 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:49:12.603332 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d17562ae-c894-4b4e-9ab7-bcdd52985e16 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:12.604516 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d17562ae-c894-4b4e-9ab7-bcdd52985e16 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:12.611075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d17562ae-c894-4b4e-9ab7-bcdd52985e16 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:12.611520 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d17562ae-c894-4b4e-9ab7-bcdd52985e16 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:12.612297 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d17562ae-c894-4b4e-9ab7-bcdd52985e16 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:12.612733 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d17562ae-c894-4b4e-9ab7-bcdd52985e16 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:12.745331 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d17562ae-c894-4b4e-9ab7-bcdd52985e16 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:12.753298 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d17562ae-c894-4b4e-9ab7-bcdd52985e16 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.153923 Jul 14 11:49:12.753875 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 378/710] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:12 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:12.836334 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-2d5effa7-6673-422f-88f5-7f686ef3e618 req-adad9fa6-f3ac-47a1-88b3-89d95ad19d53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046cf283-3c75-404b-b0a5-47ff4e2b9b38", "tag": "2bf88cae-cdc5-4206-8a26-2e2997ddefac"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:49:12.845394 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-2d5effa7-6673-422f-88f5-7f686ef3e618 req-adad9fa6-f3ac-47a1-88b3-89d95ad19d53 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:12.845841 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-2d5effa7-6673-422f-88f5-7f686ef3e618 req-adad9fa6-f3ac-47a1-88b3-89d95ad19d53 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:12.857351 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-2d5effa7-6673-422f-88f5-7f686ef3e618 req-adad9fa6-f3ac-47a1-88b3-89d95ad19d53 service nova] Creating event network-changed:2bf88cae-cdc5-4206-8a26-2e2997ddefac for instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 on hv-cinder-84980 Jul 14 11:49:12.862504 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-2d5effa7-6673-422f-88f5-7f686ef3e618 req-adad9fa6-f3ac-47a1-88b3-89d95ad19d53 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030072 Jul 14 11:49:12.863429 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 333/711] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:13.350453 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7258a5a1-4838-4ef2-ae96-8ff764ef4954 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:13.351071 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7258a5a1-4838-4ef2-ae96-8ff764ef4954 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:13.357244 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7258a5a1-4838-4ef2-ae96-8ff764ef4954 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:13.357694 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7258a5a1-4838-4ef2-ae96-8ff764ef4954 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:13.358477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7258a5a1-4838-4ef2-ae96-8ff764ef4954 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:13.358916 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7258a5a1-4838-4ef2-ae96-8ff764ef4954 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:13.513104 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7258a5a1-4838-4ef2-ae96-8ff764ef4954 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:13.521650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7258a5a1-4838-4ef2-ae96-8ff764ef4954 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1755 microversion: 2.1 time: 0.175047 Jul 14 11:49:13.522234 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 379/712] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:13 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:13.772145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-04da7731-1a62-4ffa-afa2-aefd244a8b82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:13.772870 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-04da7731-1a62-4ffa-afa2-aefd244a8b82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:13.779397 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-04da7731-1a62-4ffa-afa2-aefd244a8b82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:13.779839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-04da7731-1a62-4ffa-afa2-aefd244a8b82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:13.780598 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-04da7731-1a62-4ffa-afa2-aefd244a8b82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:13.781030 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-04da7731-1a62-4ffa-afa2-aefd244a8b82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:13.919765 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-04da7731-1a62-4ffa-afa2-aefd244a8b82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:13.927338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-04da7731-1a62-4ffa-afa2-aefd244a8b82 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.159908 Jul 14 11:49:13.927916 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 334/713] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:13 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:49:14.538682 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-920ebffd-8b2c-43f2-99e4-11d0cd0cb48a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:14.539288 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-920ebffd-8b2c-43f2-99e4-11d0cd0cb48a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:14.545792 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-920ebffd-8b2c-43f2-99e4-11d0cd0cb48a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:14.546243 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-920ebffd-8b2c-43f2-99e4-11d0cd0cb48a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:14.547012 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-920ebffd-8b2c-43f2-99e4-11d0cd0cb48a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:14.547452 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-920ebffd-8b2c-43f2-99e4-11d0cd0cb48a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:14.692231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-920ebffd-8b2c-43f2-99e4-11d0cd0cb48a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:14.700968 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-920ebffd-8b2c-43f2-99e4-11d0cd0cb48a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1758 microversion: 2.1 time: 0.166585 Jul 14 11:49:14.701635 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 380/714] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:14 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:14.944239 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6b773364-56c7-4ce7-9356-b3281723942c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:14.944857 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6b773364-56c7-4ce7-9356-b3281723942c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:14.952046 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6b773364-56c7-4ce7-9356-b3281723942c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:14.952493 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6b773364-56c7-4ce7-9356-b3281723942c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:14.953286 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6b773364-56c7-4ce7-9356-b3281723942c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:14.953724 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6b773364-56c7-4ce7-9356-b3281723942c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:15.090558 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6b773364-56c7-4ce7-9356-b3281723942c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:15.097986 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6b773364-56c7-4ce7-9356-b3281723942c tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.157687 Jul 14 11:49:15.101521 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 335/715] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:14 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:16.120245 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-695aac86-99dc-429a-9f68-c7df75a348a2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:16.121525 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-695aac86-99dc-429a-9f68-c7df75a348a2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:16.129746 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-695aac86-99dc-429a-9f68-c7df75a348a2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:16.130210 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-695aac86-99dc-429a-9f68-c7df75a348a2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:16.130985 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-695aac86-99dc-429a-9f68-c7df75a348a2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:16.131426 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-695aac86-99dc-429a-9f68-c7df75a348a2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:16.323858 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-695aac86-99dc-429a-9f68-c7df75a348a2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:16.331342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-695aac86-99dc-429a-9f68-c7df75a348a2 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.219123 Jul 14 11:49:16.331930 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 381/716] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:16 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:17.357025 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-941ca8d2-6371-493d-b8e7-9f98b802d3c9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:17.357609 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-941ca8d2-6371-493d-b8e7-9f98b802d3c9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:17.364395 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-941ca8d2-6371-493d-b8e7-9f98b802d3c9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:17.364888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-941ca8d2-6371-493d-b8e7-9f98b802d3c9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:17.365695 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-941ca8d2-6371-493d-b8e7-9f98b802d3c9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:17.366074 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-941ca8d2-6371-493d-b8e7-9f98b802d3c9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:17.506063 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-941ca8d2-6371-493d-b8e7-9f98b802d3c9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:17.514152 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-941ca8d2-6371-493d-b8e7-9f98b802d3c9 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.168897 Jul 14 11:49:17.514759 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 336/717] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:17 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:49:17.522079 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-538a5baf-df57-4eb2-8da0-2cc92f2d6762 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:17.522595 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-538a5baf-df57-4eb2-8da0-2cc92f2d6762 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:17.529687 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-538a5baf-df57-4eb2-8da0-2cc92f2d6762 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:17.530137 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-538a5baf-df57-4eb2-8da0-2cc92f2d6762 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:17.530907 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-538a5baf-df57-4eb2-8da0-2cc92f2d6762 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:17.531347 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-538a5baf-df57-4eb2-8da0-2cc92f2d6762 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:17.555399 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-538a5baf-df57-4eb2-8da0-2cc92f2d6762 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404/ips" status: 200 len: 152 microversion: 2.20 time: 0.093487 Jul 14 11:49:17.555953 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 382/718] 10.222.0.40 () {60 vars in 1288 bytes} [Thu Jul 14 11:49:17 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404/ips => generated 152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 11:49:18.531227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e1406495-9e92-45c6-9767-881f2d2d1c3e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:18.531869 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e1406495-9e92-45c6-9767-881f2d2d1c3e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:18.538292 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e1406495-9e92-45c6-9767-881f2d2d1c3e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:18.539358 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e1406495-9e92-45c6-9767-881f2d2d1c3e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:18.540122 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e1406495-9e92-45c6-9767-881f2d2d1c3e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:18.540580 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e1406495-9e92-45c6-9767-881f2d2d1c3e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:18.677958 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e1406495-9e92-45c6-9767-881f2d2d1c3e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:18.685536 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e1406495-9e92-45c6-9767-881f2d2d1c3e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.158132 Jul 14 11:49:18.689642 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 337/719] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:18 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:19.703052 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-fb3fe6ba-d277-4449-80cb-683e154a05fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:19.703749 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-fb3fe6ba-d277-4449-80cb-683e154a05fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:19.710281 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fb3fe6ba-d277-4449-80cb-683e154a05fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:19.710733 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fb3fe6ba-d277-4449-80cb-683e154a05fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:19.711506 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fb3fe6ba-d277-4449-80cb-683e154a05fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:19.711941 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fb3fe6ba-d277-4449-80cb-683e154a05fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:19.845374 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-fb3fe6ba-d277-4449-80cb-683e154a05fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:19.854178 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-fb3fe6ba-d277-4449-80cb-683e154a05fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1571 microversion: 2.1 time: 0.154490 Jul 14 11:49:19.854785 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 383/720] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:19 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:19.871348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-0820949e-4471-49f6-bb10-13278b9aff5b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:49:19.872104 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-0820949e-4471-49f6-bb10-13278b9aff5b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:19.880488 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0820949e-4471-49f6-bb10-13278b9aff5b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:19.882388 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0820949e-4471-49f6-bb10-13278b9aff5b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:19.882388 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0820949e-4471-49f6-bb10-13278b9aff5b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:19.882388 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0820949e-4471-49f6-bb10-13278b9aff5b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:19.888783 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=100 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:20.036059 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-dc0c68a2-16a2-4ef3-b582-be7b473fa648 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:49:20.036585 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-dc0c68a2-16a2-4ef3-b582-be7b473fa648 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:20.043443 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dc0c68a2-16a2-4ef3-b582-be7b473fa648 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:20.043893 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dc0c68a2-16a2-4ef3-b582-be7b473fa648 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:20.044666 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dc0c68a2-16a2-4ef3-b582-be7b473fa648 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:20.045099 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dc0c68a2-16a2-4ef3-b582-be7b473fa648 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:20.047671 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=100 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:20.068149 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-dc0c68a2-16a2-4ef3-b582-be7b473fa648 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lazy-loading 'flavor' on Instance uuid e08c817f-cc75-4c71-8645-51a7a1938404 {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:49:20.180816 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-0820949e-4471-49f6-bb10-13278b9aff5b tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "POST /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1/action" status: 202 len: 0 microversion: 2.1 time: 0.314157 Jul 14 11:49:20.183790 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 338/721] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 11:49:19 2022] POST /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:49:20.189427 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-68b5ac1e-227f-4d4a-86d9-e08d36111370 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:20.190052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-68b5ac1e-227f-4d4a-86d9-e08d36111370 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:20.200796 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-68b5ac1e-227f-4d4a-86d9-e08d36111370 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:20.201290 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-68b5ac1e-227f-4d4a-86d9-e08d36111370 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:20.202068 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-68b5ac1e-227f-4d4a-86d9-e08d36111370 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:20.202507 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-68b5ac1e-227f-4d4a-86d9-e08d36111370 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:20.336245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-68b5ac1e-227f-4d4a-86d9-e08d36111370 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:20.344592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-68b5ac1e-227f-4d4a-86d9-e08d36111370 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1519 microversion: 2.1 time: 0.159039 Jul 14 11:49:20.345186 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 339/722] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:20 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:49:20.647498 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-dc0c68a2-16a2-4ef3-b582-be7b473fa648 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "POST /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404/action" status: 202 len: 0 microversion: 2.20 time: 0.615172 Jul 14 11:49:20.648402 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 384/723] 10.222.0.40 () {62 vars in 1318 bytes} [Thu Jul 14 11:49:20 2022] POST /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:49:20.656720 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a6c001f1-d8fd-4a09-a798-0ce7cdcb152e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:20.657450 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a6c001f1-d8fd-4a09-a798-0ce7cdcb152e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:20.663660 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a6c001f1-d8fd-4a09-a798-0ce7cdcb152e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:20.664225 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a6c001f1-d8fd-4a09-a798-0ce7cdcb152e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:20.665060 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a6c001f1-d8fd-4a09-a798-0ce7cdcb152e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:20.665572 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a6c001f1-d8fd-4a09-a798-0ce7cdcb152e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:20.800490 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a6c001f1-d8fd-4a09-a798-0ce7cdcb152e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:20.809182 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a6c001f1-d8fd-4a09-a798-0ce7cdcb152e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:20.810704 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a6c001f1-d8fd-4a09-a798-0ce7cdcb152e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:20.811852 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a6c001f1-d8fd-4a09-a798-0ce7cdcb152e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.159015 Jul 14 11:49:20.812398 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 340/724] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:20 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:21.362908 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-dacdba1e-fb1c-4c96-a4eb-aad9332187c0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:21.363617 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-dacdba1e-fb1c-4c96-a4eb-aad9332187c0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:21.369990 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dacdba1e-fb1c-4c96-a4eb-aad9332187c0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:21.370955 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dacdba1e-fb1c-4c96-a4eb-aad9332187c0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:21.371732 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dacdba1e-fb1c-4c96-a4eb-aad9332187c0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:21.372172 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dacdba1e-fb1c-4c96-a4eb-aad9332187c0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:21.505515 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-dacdba1e-fb1c-4c96-a4eb-aad9332187c0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:21.513005 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-dacdba1e-fb1c-4c96-a4eb-aad9332187c0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1521 microversion: 2.1 time: 0.154846 Jul 14 11:49:21.513594 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 385/725] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:21 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:21.830085 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-681a34eb-ac17-4bf5-a3a9-9908200ecf2d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:21.830680 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-681a34eb-ac17-4bf5-a3a9-9908200ecf2d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:21.837285 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-681a34eb-ac17-4bf5-a3a9-9908200ecf2d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:21.837672 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-681a34eb-ac17-4bf5-a3a9-9908200ecf2d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:21.838440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-681a34eb-ac17-4bf5-a3a9-9908200ecf2d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:21.838876 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-681a34eb-ac17-4bf5-a3a9-9908200ecf2d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:21.977856 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-681a34eb-ac17-4bf5-a3a9-9908200ecf2d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:21.986549 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-681a34eb-ac17-4bf5-a3a9-9908200ecf2d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:21.990955 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-681a34eb-ac17-4bf5-a3a9-9908200ecf2d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:21.990955 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-681a34eb-ac17-4bf5-a3a9-9908200ecf2d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.163028 Jul 14 11:49:21.990955 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 341/726] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:21 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:22.531271 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9a0bf9e1-0fce-48a3-81cb-12c076b9b0f7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:22.531945 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9a0bf9e1-0fce-48a3-81cb-12c076b9b0f7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:22.538718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9a0bf9e1-0fce-48a3-81cb-12c076b9b0f7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:22.539165 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9a0bf9e1-0fce-48a3-81cb-12c076b9b0f7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:22.539971 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9a0bf9e1-0fce-48a3-81cb-12c076b9b0f7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:22.540414 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9a0bf9e1-0fce-48a3-81cb-12c076b9b0f7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:22.672310 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9a0bf9e1-0fce-48a3-81cb-12c076b9b0f7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:22.679935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9a0bf9e1-0fce-48a3-81cb-12c076b9b0f7 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1521 microversion: 2.1 time: 0.152949 Jul 14 11:49:22.680511 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 386/727] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:22 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:23.007820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-17d3b6e4-645b-43e2-8994-e348f4afb20a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:23.008492 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-17d3b6e4-645b-43e2-8994-e348f4afb20a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:23.014966 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-17d3b6e4-645b-43e2-8994-e348f4afb20a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:23.015414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-17d3b6e4-645b-43e2-8994-e348f4afb20a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:23.016185 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-17d3b6e4-645b-43e2-8994-e348f4afb20a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:23.016622 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-17d3b6e4-645b-43e2-8994-e348f4afb20a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:23.213947 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-17d3b6e4-645b-43e2-8994-e348f4afb20a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:23.223345 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-17d3b6e4-645b-43e2-8994-e348f4afb20a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:23.225334 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-17d3b6e4-645b-43e2-8994-e348f4afb20a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:23.226692 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-17d3b6e4-645b-43e2-8994-e348f4afb20a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.222736 Jul 14 11:49:23.227406 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 342/728] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:23 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:23.234914 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-22f2504a-6415-47c4-b36e-1e73df9b9d6f req-e0cadc6c-5e81-4e03-b657-62a8a2217394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee797cbe-7b7e-4e87-9da7-0c628ae3ede1", "name": "network-vif-unplugged", "status": "completed", "tag": "df04a441-a4c9-485f-845a-68acb74d2d4e"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:49:23.243759 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-22f2504a-6415-47c4-b36e-1e73df9b9d6f req-e0cadc6c-5e81-4e03-b657-62a8a2217394 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:23.244207 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-22f2504a-6415-47c4-b36e-1e73df9b9d6f req-e0cadc6c-5e81-4e03-b657-62a8a2217394 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:23.257052 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-22f2504a-6415-47c4-b36e-1e73df9b9d6f req-e0cadc6c-5e81-4e03-b657-62a8a2217394 service nova] Creating event network-vif-unplugged:df04a441-a4c9-485f-845a-68acb74d2d4e for instance ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 on hv-cinder-84980 Jul 14 11:49:23.262243 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-22f2504a-6415-47c4-b36e-1e73df9b9d6f req-e0cadc6c-5e81-4e03-b657-62a8a2217394 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030912 Jul 14 11:49:23.263031 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 387/729] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:23.697750 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d02d5fb7-4bcc-4410-b4ac-1c12b9c25b48 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:23.698315 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d02d5fb7-4bcc-4410-b4ac-1c12b9c25b48 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:23.704829 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d02d5fb7-4bcc-4410-b4ac-1c12b9c25b48 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:23.705307 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d02d5fb7-4bcc-4410-b4ac-1c12b9c25b48 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:23.706063 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d02d5fb7-4bcc-4410-b4ac-1c12b9c25b48 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:23.706521 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d02d5fb7-4bcc-4410-b4ac-1c12b9c25b48 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:23.840178 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d02d5fb7-4bcc-4410-b4ac-1c12b9c25b48 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:23.847788 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d02d5fb7-4bcc-4410-b4ac-1c12b9c25b48 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1577 microversion: 2.1 time: 0.154050 Jul 14 11:49:23.852269 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 343/730] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:23 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:24.247215 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-e8150613-f832-456e-88d2-e673d1cc0c83 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:24.247836 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-e8150613-f832-456e-88d2-e673d1cc0c83 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:24.254016 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e8150613-f832-456e-88d2-e673d1cc0c83 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:24.254460 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e8150613-f832-456e-88d2-e673d1cc0c83 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:24.255223 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e8150613-f832-456e-88d2-e673d1cc0c83 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:24.255658 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e8150613-f832-456e-88d2-e673d1cc0c83 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:24.390256 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e8150613-f832-456e-88d2-e673d1cc0c83 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:24.398779 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e8150613-f832-456e-88d2-e673d1cc0c83 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:24.400284 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e8150613-f832-456e-88d2-e673d1cc0c83 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:24.401467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-e8150613-f832-456e-88d2-e673d1cc0c83 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.159103 Jul 14 11:49:24.402635 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 388/731] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:24 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:24.864819 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-14af2118-f125-4ff4-b8f5-7c08a44747c1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:24.865457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-14af2118-f125-4ff4-b8f5-7c08a44747c1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:24.871991 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-14af2118-f125-4ff4-b8f5-7c08a44747c1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:24.872475 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-14af2118-f125-4ff4-b8f5-7c08a44747c1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:24.873303 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-14af2118-f125-4ff4-b8f5-7c08a44747c1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:24.873749 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-14af2118-f125-4ff4-b8f5-7c08a44747c1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:25.004665 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-14af2118-f125-4ff4-b8f5-7c08a44747c1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:25.012218 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-14af2118-f125-4ff4-b8f5-7c08a44747c1 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1577 microversion: 2.1 time: 0.151236 Jul 14 11:49:25.012778 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 344/732] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:24 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:25.420053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9371c762-9ac9-427c-96e1-f64857c75099 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:25.420664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9371c762-9ac9-427c-96e1-f64857c75099 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:25.426677 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9371c762-9ac9-427c-96e1-f64857c75099 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:25.427122 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9371c762-9ac9-427c-96e1-f64857c75099 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:25.427876 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9371c762-9ac9-427c-96e1-f64857c75099 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:25.428313 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9371c762-9ac9-427c-96e1-f64857c75099 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:25.556674 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9371c762-9ac9-427c-96e1-f64857c75099 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:25.565082 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9371c762-9ac9-427c-96e1-f64857c75099 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:25.566622 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9371c762-9ac9-427c-96e1-f64857c75099 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:25.567771 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9371c762-9ac9-427c-96e1-f64857c75099 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.151843 Jul 14 11:49:25.568322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 389/733] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:25 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:26.030152 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-af885f19-44c9-4631-92b1-3087ef063b1e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:26.030776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-af885f19-44c9-4631-92b1-3087ef063b1e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:26.037304 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-af885f19-44c9-4631-92b1-3087ef063b1e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:26.037758 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-af885f19-44c9-4631-92b1-3087ef063b1e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:26.038525 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-af885f19-44c9-4631-92b1-3087ef063b1e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:26.038971 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-af885f19-44c9-4631-92b1-3087ef063b1e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:26.173289 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-af885f19-44c9-4631-92b1-3087ef063b1e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:26.180821 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-af885f19-44c9-4631-92b1-3087ef063b1e tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1577 microversion: 2.1 time: 0.155196 Jul 14 11:49:26.181414 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 345/734] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:26 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:49:26.585517 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3e9effa4-094c-4ded-8a8a-4d2dff3481be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:26.586127 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3e9effa4-094c-4ded-8a8a-4d2dff3481be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:26.593656 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3e9effa4-094c-4ded-8a8a-4d2dff3481be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:26.594108 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3e9effa4-094c-4ded-8a8a-4d2dff3481be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:26.594873 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3e9effa4-094c-4ded-8a8a-4d2dff3481be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:26.595311 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3e9effa4-094c-4ded-8a8a-4d2dff3481be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:26.727331 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3e9effa4-094c-4ded-8a8a-4d2dff3481be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:26.735114 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3e9effa4-094c-4ded-8a8a-4d2dff3481be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:26.736635 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3e9effa4-094c-4ded-8a8a-4d2dff3481be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:26.737806 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3e9effa4-094c-4ded-8a8a-4d2dff3481be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.156372 Jul 14 11:49:26.738362 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 390/735] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:26 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:27.197981 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5646fbf6-f8a3-4f84-8e5a-9acff2e3add4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:27.199289 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5646fbf6-f8a3-4f84-8e5a-9acff2e3add4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:27.205723 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5646fbf6-f8a3-4f84-8e5a-9acff2e3add4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:27.206164 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5646fbf6-f8a3-4f84-8e5a-9acff2e3add4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:27.206923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5646fbf6-f8a3-4f84-8e5a-9acff2e3add4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:27.207359 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5646fbf6-f8a3-4f84-8e5a-9acff2e3add4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:27.338367 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5646fbf6-f8a3-4f84-8e5a-9acff2e3add4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:27.345838 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5646fbf6-f8a3-4f84-8e5a-9acff2e3add4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1577 microversion: 2.1 time: 0.151865 Jul 14 11:49:27.347708 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 346/736] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:27 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:27.756651 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-0361663c-c14a-4d40-9556-3ddf3ff81f52 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:27.757302 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-0361663c-c14a-4d40-9556-3ddf3ff81f52 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:27.759838 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=78 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:27.764662 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0361663c-c14a-4d40-9556-3ddf3ff81f52 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:27.765133 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0361663c-c14a-4d40-9556-3ddf3ff81f52 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:27.765936 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0361663c-c14a-4d40-9556-3ddf3ff81f52 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:27.766372 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0361663c-c14a-4d40-9556-3ddf3ff81f52 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:27.896750 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-0361663c-c14a-4d40-9556-3ddf3ff81f52 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:27.905497 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-0361663c-c14a-4d40-9556-3ddf3ff81f52 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:27.906985 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-0361663c-c14a-4d40-9556-3ddf3ff81f52 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:27.908128 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-0361663c-c14a-4d40-9556-3ddf3ff81f52 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.156201 Jul 14 11:49:27.908684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 391/737] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:27 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:28.362513 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9df1843c-6c9f-4c97-9367-3aa8e18d7931 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:28.363160 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9df1843c-6c9f-4c97-9367-3aa8e18d7931 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:28.369743 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9df1843c-6c9f-4c97-9367-3aa8e18d7931 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:28.370590 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9df1843c-6c9f-4c97-9367-3aa8e18d7931 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:28.370966 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9df1843c-6c9f-4c97-9367-3aa8e18d7931 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:28.372029 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9df1843c-6c9f-4c97-9367-3aa8e18d7931 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:28.504926 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9df1843c-6c9f-4c97-9367-3aa8e18d7931 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:28.513126 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9df1843c-6c9f-4c97-9367-3aa8e18d7931 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1577 microversion: 2.1 time: 0.154479 Jul 14 11:49:28.513721 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 347/738] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:28 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:28.926702 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-85f8f9f6-d7e4-45ce-a519-21a53eb28754 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:28.927318 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-85f8f9f6-d7e4-45ce-a519-21a53eb28754 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:28.934390 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85f8f9f6-d7e4-45ce-a519-21a53eb28754 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:28.934883 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85f8f9f6-d7e4-45ce-a519-21a53eb28754 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:28.935604 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85f8f9f6-d7e4-45ce-a519-21a53eb28754 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:28.936039 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85f8f9f6-d7e4-45ce-a519-21a53eb28754 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:29.066736 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-85f8f9f6-d7e4-45ce-a519-21a53eb28754 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:29.074684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-85f8f9f6-d7e4-45ce-a519-21a53eb28754 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:29.076210 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-85f8f9f6-d7e4-45ce-a519-21a53eb28754 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:29.077405 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-85f8f9f6-d7e4-45ce-a519-21a53eb28754 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.154661 Jul 14 11:49:29.077975 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 392/739] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:28 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:29.530291 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-88c579ec-df5a-4937-a749-af5720757476 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:29.530903 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-88c579ec-df5a-4937-a749-af5720757476 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:29.537654 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-88c579ec-df5a-4937-a749-af5720757476 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:29.538112 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-88c579ec-df5a-4937-a749-af5720757476 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:29.539796 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-88c579ec-df5a-4937-a749-af5720757476 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:29.539796 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-88c579ec-df5a-4937-a749-af5720757476 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:29.671377 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-88c579ec-df5a-4937-a749-af5720757476 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:29.678713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-88c579ec-df5a-4937-a749-af5720757476 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1577 microversion: 2.1 time: 0.152816 Jul 14 11:49:29.679270 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 348/740] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:29 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:30.096324 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-aeae2440-f1dc-426d-93fe-a6889c5012f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:30.096855 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-aeae2440-f1dc-426d-93fe-a6889c5012f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:30.103406 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aeae2440-f1dc-426d-93fe-a6889c5012f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:30.103847 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aeae2440-f1dc-426d-93fe-a6889c5012f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:30.104606 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aeae2440-f1dc-426d-93fe-a6889c5012f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:30.105036 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aeae2440-f1dc-426d-93fe-a6889c5012f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:30.239137 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-aeae2440-f1dc-426d-93fe-a6889c5012f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:30.247594 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-aeae2440-f1dc-426d-93fe-a6889c5012f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:30.249116 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-aeae2440-f1dc-426d-93fe-a6889c5012f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:30.250304 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-aeae2440-f1dc-426d-93fe-a6889c5012f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.158104 Jul 14 11:49:30.250879 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 393/741] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:30 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:30.694660 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-34b4afc3-0e47-447f-b029-96ebe7ba274a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:30.695272 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-34b4afc3-0e47-447f-b029-96ebe7ba274a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:30.702405 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-34b4afc3-0e47-447f-b029-96ebe7ba274a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:30.702851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-34b4afc3-0e47-447f-b029-96ebe7ba274a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:30.703618 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-34b4afc3-0e47-447f-b029-96ebe7ba274a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:30.704052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-34b4afc3-0e47-447f-b029-96ebe7ba274a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:30.837685 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-34b4afc3-0e47-447f-b029-96ebe7ba274a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:30.845819 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-34b4afc3-0e47-447f-b029-96ebe7ba274a tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1577 microversion: 2.1 time: 0.154972 Jul 14 11:49:30.846377 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 349/742] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:30 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:31.268397 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6f00382a-5304-4607-80f8-089ab89032fe tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:31.269043 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6f00382a-5304-4607-80f8-089ab89032fe tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:31.275888 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6f00382a-5304-4607-80f8-089ab89032fe tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:31.276338 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6f00382a-5304-4607-80f8-089ab89032fe tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:31.277103 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6f00382a-5304-4607-80f8-089ab89032fe tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:31.278252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6f00382a-5304-4607-80f8-089ab89032fe tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:31.406447 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6f00382a-5304-4607-80f8-089ab89032fe tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:31.414405 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6f00382a-5304-4607-80f8-089ab89032fe tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:31.415907 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6f00382a-5304-4607-80f8-089ab89032fe tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:31.417049 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6f00382a-5304-4607-80f8-089ab89032fe tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.152637 Jul 14 11:49:31.417631 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 394/743] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:31 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:31.865907 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-90aad20b-df74-432c-a06f-6ee8bfcc5788 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:31.866530 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-90aad20b-df74-432c-a06f-6ee8bfcc5788 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:31.874001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-90aad20b-df74-432c-a06f-6ee8bfcc5788 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:31.874452 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-90aad20b-df74-432c-a06f-6ee8bfcc5788 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:31.875222 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-90aad20b-df74-432c-a06f-6ee8bfcc5788 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:31.875659 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-90aad20b-df74-432c-a06f-6ee8bfcc5788 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:32.010703 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-90aad20b-df74-432c-a06f-6ee8bfcc5788 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:32.018308 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-90aad20b-df74-432c-a06f-6ee8bfcc5788 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1577 microversion: 2.1 time: 0.158787 Jul 14 11:49:32.019108 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 350/744] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:31 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:32.435220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b43afcfd-26df-4b39-a598-416d170ce89e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:32.435831 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b43afcfd-26df-4b39-a598-416d170ce89e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:32.442810 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b43afcfd-26df-4b39-a598-416d170ce89e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:32.443257 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b43afcfd-26df-4b39-a598-416d170ce89e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:32.444027 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b43afcfd-26df-4b39-a598-416d170ce89e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:32.444459 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b43afcfd-26df-4b39-a598-416d170ce89e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:32.590864 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b43afcfd-26df-4b39-a598-416d170ce89e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:32.604486 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b43afcfd-26df-4b39-a598-416d170ce89e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:32.606925 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b43afcfd-26df-4b39-a598-416d170ce89e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:32.608197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b43afcfd-26df-4b39-a598-416d170ce89e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.177190 Jul 14 11:49:32.608821 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 395/745] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:32 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:33.035652 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-93e6d872-be5c-4b42-b0ca-cc44fd012aae tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:33.036306 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-93e6d872-be5c-4b42-b0ca-cc44fd012aae tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:33.042889 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-93e6d872-be5c-4b42-b0ca-cc44fd012aae tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:33.044065 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-93e6d872-be5c-4b42-b0ca-cc44fd012aae tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:33.044909 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-93e6d872-be5c-4b42-b0ca-cc44fd012aae tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:33.045379 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-93e6d872-be5c-4b42-b0ca-cc44fd012aae tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:33.178420 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-93e6d872-be5c-4b42-b0ca-cc44fd012aae tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:33.186249 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-93e6d872-be5c-4b42-b0ca-cc44fd012aae tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1564 microversion: 2.1 time: 0.154491 Jul 14 11:49:33.186919 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 351/746] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:33 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:33.627231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-94971ffe-7334-4309-a805-7b00aae904b7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:33.627849 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-94971ffe-7334-4309-a805-7b00aae904b7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:33.634482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-94971ffe-7334-4309-a805-7b00aae904b7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:33.634937 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-94971ffe-7334-4309-a805-7b00aae904b7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:33.635772 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-94971ffe-7334-4309-a805-7b00aae904b7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:33.636215 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-94971ffe-7334-4309-a805-7b00aae904b7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:33.763895 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-94971ffe-7334-4309-a805-7b00aae904b7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:33.771850 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-94971ffe-7334-4309-a805-7b00aae904b7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:33.773746 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-94971ffe-7334-4309-a805-7b00aae904b7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:33.774911 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-94971ffe-7334-4309-a805-7b00aae904b7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.151889 Jul 14 11:49:33.775478 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 396/747] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:33 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:34.793559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ed161e5e-3964-4a88-b67c-23d56be69568 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:34.794175 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ed161e5e-3964-4a88-b67c-23d56be69568 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:34.796746 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=68 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:34.801756 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ed161e5e-3964-4a88-b67c-23d56be69568 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:34.802728 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ed161e5e-3964-4a88-b67c-23d56be69568 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:34.803052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ed161e5e-3964-4a88-b67c-23d56be69568 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:34.803433 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ed161e5e-3964-4a88-b67c-23d56be69568 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:34.935669 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ed161e5e-3964-4a88-b67c-23d56be69568 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:34.943678 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ed161e5e-3964-4a88-b67c-23d56be69568 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:34.945203 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ed161e5e-3964-4a88-b67c-23d56be69568 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:34.946362 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ed161e5e-3964-4a88-b67c-23d56be69568 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.156901 Jul 14 11:49:34.946918 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 352/748] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:34 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:35.298069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-eba3fbbc-37c0-4022-969e-a7ab1a7faf09 req-83ed6c6b-0978-4f9e-bbc8-f7c4597d9a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee797cbe-7b7e-4e87-9da7-0c628ae3ede1", "name": "network-vif-plugged", "status": "completed", "tag": "df04a441-a4c9-485f-845a-68acb74d2d4e"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:49:35.306543 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-eba3fbbc-37c0-4022-969e-a7ab1a7faf09 req-83ed6c6b-0978-4f9e-bbc8-f7c4597d9a68 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:35.306981 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-eba3fbbc-37c0-4022-969e-a7ab1a7faf09 req-83ed6c6b-0978-4f9e-bbc8-f7c4597d9a68 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:35.317937 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-eba3fbbc-37c0-4022-969e-a7ab1a7faf09 req-83ed6c6b-0978-4f9e-bbc8-f7c4597d9a68 service nova] Creating event network-vif-plugged:df04a441-a4c9-485f-845a-68acb74d2d4e for instance ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 on hv-cinder-84980 Jul 14 11:49:35.322850 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-eba3fbbc-37c0-4022-969e-a7ab1a7faf09 req-83ed6c6b-0978-4f9e-bbc8-f7c4597d9a68 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028525 Jul 14 11:49:35.323969 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 397/749] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:35.964553 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-242e1890-0dae-405f-861c-3d374a97bc09 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:35.965216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-242e1890-0dae-405f-861c-3d374a97bc09 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:35.971818 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-242e1890-0dae-405f-861c-3d374a97bc09 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:35.972260 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-242e1890-0dae-405f-861c-3d374a97bc09 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:35.973014 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-242e1890-0dae-405f-861c-3d374a97bc09 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:35.973486 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-242e1890-0dae-405f-861c-3d374a97bc09 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:36.103183 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-242e1890-0dae-405f-861c-3d374a97bc09 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:36.105446 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:36.112232 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-242e1890-0dae-405f-861c-3d374a97bc09 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:36.115368 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-242e1890-0dae-405f-861c-3d374a97bc09 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:36.115368 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-242e1890-0dae-405f-861c-3d374a97bc09 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.154413 Jul 14 11:49:36.115693 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 353/750] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:35 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:37.134768 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-4e25d85a-ad72-481e-afaa-df59250044e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:37.135373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-4e25d85a-ad72-481e-afaa-df59250044e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:37.141693 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4e25d85a-ad72-481e-afaa-df59250044e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:37.142143 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4e25d85a-ad72-481e-afaa-df59250044e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:37.142916 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4e25d85a-ad72-481e-afaa-df59250044e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:37.143349 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4e25d85a-ad72-481e-afaa-df59250044e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:37.279761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-4e25d85a-ad72-481e-afaa-df59250044e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:37.287784 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-4e25d85a-ad72-481e-afaa-df59250044e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:37.289340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-4e25d85a-ad72-481e-afaa-df59250044e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:37.290494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-4e25d85a-ad72-481e-afaa-df59250044e3 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.160794 Jul 14 11:49:37.291123 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 398/751] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:37 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:38.310238 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-2d16a77b-7d8d-4061-bf53-9ad7c2b2bb75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:38.310831 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-2d16a77b-7d8d-4061-bf53-9ad7c2b2bb75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:38.317744 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2d16a77b-7d8d-4061-bf53-9ad7c2b2bb75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:38.318192 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2d16a77b-7d8d-4061-bf53-9ad7c2b2bb75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:38.318961 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2d16a77b-7d8d-4061-bf53-9ad7c2b2bb75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:38.319398 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2d16a77b-7d8d-4061-bf53-9ad7c2b2bb75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:38.450982 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-2d16a77b-7d8d-4061-bf53-9ad7c2b2bb75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:38.459133 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-2d16a77b-7d8d-4061-bf53-9ad7c2b2bb75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:38.460635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-2d16a77b-7d8d-4061-bf53-9ad7c2b2bb75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:38.461819 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-2d16a77b-7d8d-4061-bf53-9ad7c2b2bb75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.155927 Jul 14 11:49:38.462382 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 354/752] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:38 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:39.480311 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-fdef90fc-a0c4-4d83-80c4-fc62430e188c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:39.480919 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-fdef90fc-a0c4-4d83-80c4-fc62430e188c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:39.487422 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fdef90fc-a0c4-4d83-80c4-fc62430e188c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:39.487873 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fdef90fc-a0c4-4d83-80c4-fc62430e188c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:39.488637 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fdef90fc-a0c4-4d83-80c4-fc62430e188c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:39.489075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fdef90fc-a0c4-4d83-80c4-fc62430e188c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:39.619052 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-fdef90fc-a0c4-4d83-80c4-fc62430e188c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:39.626969 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-fdef90fc-a0c4-4d83-80c4-fc62430e188c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:39.628500 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-fdef90fc-a0c4-4d83-80c4-fc62430e188c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:39.629700 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-fdef90fc-a0c4-4d83-80c4-fc62430e188c tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.153354 Jul 14 11:49:39.630269 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 399/753] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:39 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:49:39.796234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-fc296a93-21a0-47ee-8cf3-e71fa43ab9d7 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:39.796814 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-fc296a93-21a0-47ee-8cf3-e71fa43ab9d7 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:39.803161 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fc296a93-21a0-47ee-8cf3-e71fa43ab9d7 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:39.803614 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fc296a93-21a0-47ee-8cf3-e71fa43ab9d7 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:39.804391 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fc296a93-21a0-47ee-8cf3-e71fa43ab9d7 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:39.804830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fc296a93-21a0-47ee-8cf3-e71fa43ab9d7 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:39.830097 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-fc296a93-21a0-47ee-8cf3-e71fa43ab9d7 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/ips" status: 200 len: 146 microversion: 2.1 time: 0.092126 Jul 14 11:49:39.830655 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 355/754] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 11:49:39 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/ips => generated 146 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:40.648543 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-bb6b575e-c03a-4761-8c18-af3b6c73195d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:40.649086 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-bb6b575e-c03a-4761-8c18-af3b6c73195d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:40.656001 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bb6b575e-c03a-4761-8c18-af3b6c73195d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:40.656516 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bb6b575e-c03a-4761-8c18-af3b6c73195d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:40.657224 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bb6b575e-c03a-4761-8c18-af3b6c73195d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:40.657655 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bb6b575e-c03a-4761-8c18-af3b6c73195d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:40.660255 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:40.786072 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-bb6b575e-c03a-4761-8c18-af3b6c73195d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:40.794388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-bb6b575e-c03a-4761-8c18-af3b6c73195d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:40.795943 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-bb6b575e-c03a-4761-8c18-af3b6c73195d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:40.797122 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-bb6b575e-c03a-4761-8c18-af3b6c73195d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.152856 Jul 14 11:49:40.797712 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 400/755] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:40 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:41.455698 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-12ace811-0532-4cb0-b88c-b58cd2b19784 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae3b445b-9e46-48f0-9b06-7d3d33e8ff33"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:49:41.456865 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-12ace811-0532-4cb0-b88c-b58cd2b19784 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:41.463363 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-12ace811-0532-4cb0-b88c-b58cd2b19784 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:41.463803 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-12ace811-0532-4cb0-b88c-b58cd2b19784 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:41.464559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-12ace811-0532-4cb0-b88c-b58cd2b19784 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:41.465525 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-12ace811-0532-4cb0-b88c-b58cd2b19784 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:41.815216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6bb24d82-662a-4349-91c6-5394ae2e0f3f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:41.815830 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6bb24d82-662a-4349-91c6-5394ae2e0f3f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:41.822277 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6bb24d82-662a-4349-91c6-5394ae2e0f3f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:41.822726 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6bb24d82-662a-4349-91c6-5394ae2e0f3f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:41.823491 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6bb24d82-662a-4349-91c6-5394ae2e0f3f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:41.824433 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6bb24d82-662a-4349-91c6-5394ae2e0f3f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:41.955491 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6bb24d82-662a-4349-91c6-5394ae2e0f3f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:41.963579 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6bb24d82-662a-4349-91c6-5394ae2e0f3f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:41.965694 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6bb24d82-662a-4349-91c6-5394ae2e0f3f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:41.966865 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6bb24d82-662a-4349-91c6-5394ae2e0f3f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1745 microversion: 2.20 time: 0.155539 Jul 14 11:49:41.967440 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 401/756] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:41 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:49:42.221483 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-12ace811-0532-4cb0-b88c-b58cd2b19784 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "POST /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.769510 Jul 14 11:49:42.222160 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 356/757] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 11:49:41 2022] POST /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments => generated 194 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:42.987729 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-e86f3156-8d85-424b-a5b5-501e98fbc4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:42.988329 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-e86f3156-8d85-424b-a5b5-501e98fbc4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:42.996395 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e86f3156-8d85-424b-a5b5-501e98fbc4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:42.996838 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e86f3156-8d85-424b-a5b5-501e98fbc4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:42.997633 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e86f3156-8d85-424b-a5b5-501e98fbc4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:42.998060 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-e86f3156-8d85-424b-a5b5-501e98fbc4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:43.130388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e86f3156-8d85-424b-a5b5-501e98fbc4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:43.138638 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e86f3156-8d85-424b-a5b5-501e98fbc4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:43.140333 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-e86f3156-8d85-424b-a5b5-501e98fbc4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:43.141538 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-e86f3156-8d85-424b-a5b5-501e98fbc4a8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1745 microversion: 2.20 time: 0.157622 Jul 14 11:49:43.142131 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 402/758] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:42 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:44.160842 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-f9413dc2-507b-423c-8498-e86adcd75c5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:44.161574 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-f9413dc2-507b-423c-8498-e86adcd75c5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:44.167816 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f9413dc2-507b-423c-8498-e86adcd75c5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:44.168263 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f9413dc2-507b-423c-8498-e86adcd75c5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:44.169025 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f9413dc2-507b-423c-8498-e86adcd75c5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:44.169520 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f9413dc2-507b-423c-8498-e86adcd75c5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:44.276889 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ae7742f1-001b-43f6-9446-efbff00e4849 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:44.277748 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ae7742f1-001b-43f6-9446-efbff00e4849 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:44.284273 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ae7742f1-001b-43f6-9446-efbff00e4849 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:44.284721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ae7742f1-001b-43f6-9446-efbff00e4849 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:44.285518 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ae7742f1-001b-43f6-9446-efbff00e4849 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:44.285954 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ae7742f1-001b-43f6-9446-efbff00e4849 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:44.301519 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f9413dc2-507b-423c-8498-e86adcd75c5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:44.309967 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f9413dc2-507b-423c-8498-e86adcd75c5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:44.311454 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f9413dc2-507b-423c-8498-e86adcd75c5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:44.312599 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-f9413dc2-507b-423c-8498-e86adcd75c5d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1745 microversion: 2.20 time: 0.156537 Jul 14 11:49:44.313244 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 357/759] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:44 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:44.369928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-ae7742f1-001b-43f6-9446-efbff00e4849 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lazy-loading 'services' on Instance uuid 1c667180-b390-45de-b693-7d59b8369eb6 {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:49:44.560535 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ae7742f1-001b-43f6-9446-efbff00e4849 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments/6cc33005-cf36-4ae0-acff-c1f8069a90b7" status: 202 len: 0 microversion: 2.1 time: 0.287781 Jul 14 11:49:44.561087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 403/760] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 11:49:44 2022] DELETE /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments/6cc33005-cf36-4ae0-acff-c1f8069a90b7 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:49:44.570410 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-1d3fc491-13f4-4d1f-ba1e-11beca032890 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:44.571418 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-1d3fc491-13f4-4d1f-ba1e-11beca032890 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:44.579212 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1d3fc491-13f4-4d1f-ba1e-11beca032890 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:44.582323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1d3fc491-13f4-4d1f-ba1e-11beca032890 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:44.582323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1d3fc491-13f4-4d1f-ba1e-11beca032890 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:44.582323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1d3fc491-13f4-4d1f-ba1e-11beca032890 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:44.611424 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-1d3fc491-13f4-4d1f-ba1e-11beca032890 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045749 Jul 14 11:49:44.611991 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 358/761] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:49:44 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:45.337674 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9542597c-bfbd-4edd-a67b-ed7cb1b7c114 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:45.338299 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9542597c-bfbd-4edd-a67b-ed7cb1b7c114 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:45.345506 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9542597c-bfbd-4edd-a67b-ed7cb1b7c114 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:45.345953 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9542597c-bfbd-4edd-a67b-ed7cb1b7c114 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:45.346719 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9542597c-bfbd-4edd-a67b-ed7cb1b7c114 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:45.347342 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9542597c-bfbd-4edd-a67b-ed7cb1b7c114 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:45.389581 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-4d529c41-f7c7-4739-a120-df2376bbf3e9 req-a593362e-7b29-47f7-8d8a-8a06d033e02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08c817f-cc75-4c71-8645-51a7a1938404", "name": "network-vif-plugged", "status": "completed", "tag": "5c8aa46b-5efe-4ab3-b31e-03775de21303"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:49:45.398465 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-4d529c41-f7c7-4739-a120-df2376bbf3e9 req-a593362e-7b29-47f7-8d8a-8a06d033e02e service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:45.398913 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-4d529c41-f7c7-4739-a120-df2376bbf3e9 req-a593362e-7b29-47f7-8d8a-8a06d033e02e service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:45.411251 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-4d529c41-f7c7-4739-a120-df2376bbf3e9 req-a593362e-7b29-47f7-8d8a-8a06d033e02e service nova] Creating event network-vif-plugged:5c8aa46b-5efe-4ab3-b31e-03775de21303 for instance e08c817f-cc75-4c71-8645-51a7a1938404 on hv-cinder-84980 Jul 14 11:49:45.416211 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-4d529c41-f7c7-4739-a120-df2376bbf3e9 req-a593362e-7b29-47f7-8d8a-8a06d033e02e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089537 Jul 14 11:49:45.417057 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 404/762] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:45.488776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9542597c-bfbd-4edd-a67b-ed7cb1b7c114 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:45.496682 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9542597c-bfbd-4edd-a67b-ed7cb1b7c114 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:45.498231 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9542597c-bfbd-4edd-a67b-ed7cb1b7c114 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:45.499393 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9542597c-bfbd-4edd-a67b-ed7cb1b7c114 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1745 microversion: 2.20 time: 0.166885 Jul 14 11:49:45.499948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 359/763] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:45 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:45.624107 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-193cb51c-58d4-4ba9-bd41-f0c28e2bd542 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:45.625113 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-193cb51c-58d4-4ba9-bd41-f0c28e2bd542 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:45.631557 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-193cb51c-58d4-4ba9-bd41-f0c28e2bd542 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:45.632013 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-193cb51c-58d4-4ba9-bd41-f0c28e2bd542 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:45.632782 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-193cb51c-58d4-4ba9-bd41-f0c28e2bd542 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:45.633240 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-193cb51c-58d4-4ba9-bd41-f0c28e2bd542 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:45.663515 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-193cb51c-58d4-4ba9-bd41-f0c28e2bd542 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043737 Jul 14 11:49:45.664079 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 405/764] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:49:45 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:46.518309 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-270c5cc3-4bf2-4615-8925-4d4d45417bb6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:46.520334 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-270c5cc3-4bf2-4615-8925-4d4d45417bb6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:46.529382 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-270c5cc3-4bf2-4615-8925-4d4d45417bb6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:46.530105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-270c5cc3-4bf2-4615-8925-4d4d45417bb6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:46.531089 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-270c5cc3-4bf2-4615-8925-4d4d45417bb6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:46.531532 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-270c5cc3-4bf2-4615-8925-4d4d45417bb6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:46.678823 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c0f248c1-e694-4ba9-bf32-e53f10e0b177 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:46.701971 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c0f248c1-e694-4ba9-bf32-e53f10e0b177 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:46.717943 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c0f248c1-e694-4ba9-bf32-e53f10e0b177 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:46.718392 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c0f248c1-e694-4ba9-bf32-e53f10e0b177 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:46.719175 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c0f248c1-e694-4ba9-bf32-e53f10e0b177 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:46.719603 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c0f248c1-e694-4ba9-bf32-e53f10e0b177 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:46.726957 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-270c5cc3-4bf2-4615-8925-4d4d45417bb6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:46.736381 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-270c5cc3-4bf2-4615-8925-4d4d45417bb6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:46.738570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-270c5cc3-4bf2-4615-8925-4d4d45417bb6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:46.740323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-270c5cc3-4bf2-4615-8925-4d4d45417bb6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1740 microversion: 2.20 time: 0.226027 Jul 14 11:49:46.741404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 360/765] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:46 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:46.763350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c0f248c1-e694-4ba9-bf32-e53f10e0b177 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089962 Jul 14 11:49:46.763952 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 406/766] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:49:46 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:49:47.764679 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-795e5562-b53c-48fe-b89b-ce096250672a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:47.766051 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-795e5562-b53c-48fe-b89b-ce096250672a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:47.774798 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-74ff3e44-219f-413b-8fbf-ac35b85c3584 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:47.776433 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-74ff3e44-219f-413b-8fbf-ac35b85c3584 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:47.784146 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-74ff3e44-219f-413b-8fbf-ac35b85c3584 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:47.784901 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-74ff3e44-219f-413b-8fbf-ac35b85c3584 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:47.785774 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-74ff3e44-219f-413b-8fbf-ac35b85c3584 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:47.786703 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-74ff3e44-219f-413b-8fbf-ac35b85c3584 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:47.786904 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-795e5562-b53c-48fe-b89b-ce096250672a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:47.787529 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-795e5562-b53c-48fe-b89b-ce096250672a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:47.788472 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-795e5562-b53c-48fe-b89b-ce096250672a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:47.791821 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-795e5562-b53c-48fe-b89b-ce096250672a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:47.825369 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-74ff3e44-219f-413b-8fbf-ac35b85c3584 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054885 Jul 14 11:49:47.826609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 407/767] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:49:47 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:47.968884 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-795e5562-b53c-48fe-b89b-ce096250672a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:47.977489 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-795e5562-b53c-48fe-b89b-ce096250672a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:47.979080 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-795e5562-b53c-48fe-b89b-ce096250672a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:47.980619 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-795e5562-b53c-48fe-b89b-ce096250672a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1740 microversion: 2.20 time: 0.220589 Jul 14 11:49:47.981208 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 361/768] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:47 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:48.838856 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-cf912d56-178c-450e-8781-ab4a5bf7ac1b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:48.841296 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-cf912d56-178c-450e-8781-ab4a5bf7ac1b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:48.857964 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cf912d56-178c-450e-8781-ab4a5bf7ac1b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:48.858831 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cf912d56-178c-450e-8781-ab4a5bf7ac1b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:48.859213 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cf912d56-178c-450e-8781-ab4a5bf7ac1b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:48.859655 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cf912d56-178c-450e-8781-ab4a5bf7ac1b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:48.892941 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-cf912d56-178c-450e-8781-ab4a5bf7ac1b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058659 Jul 14 11:49:48.893577 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 408/769] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:49:48 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:49.001344 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-2cbff116-8c29-4120-8288-13c5276162f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:49.002822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-2cbff116-8c29-4120-8288-13c5276162f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:49.010465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2cbff116-8c29-4120-8288-13c5276162f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:49.011118 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2cbff116-8c29-4120-8288-13c5276162f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:49.011914 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2cbff116-8c29-4120-8288-13c5276162f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:49.012355 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2cbff116-8c29-4120-8288-13c5276162f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:49.221124 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-2cbff116-8c29-4120-8288-13c5276162f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:49.221124 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-2cbff116-8c29-4120-8288-13c5276162f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:49.221477 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-2cbff116-8c29-4120-8288-13c5276162f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:49.221477 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-2cbff116-8c29-4120-8288-13c5276162f4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1740 microversion: 2.20 time: 0.169381 Jul 14 11:49:49.221477 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 362/770] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:48 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:49.913479 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ed2953de-5ccc-4bed-bfec-ddb3c321d441 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:49.914562 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ed2953de-5ccc-4bed-bfec-ddb3c321d441 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:49.924012 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ed2953de-5ccc-4bed-bfec-ddb3c321d441 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:49.925260 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ed2953de-5ccc-4bed-bfec-ddb3c321d441 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:49.925541 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ed2953de-5ccc-4bed-bfec-ddb3c321d441 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:49.926073 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ed2953de-5ccc-4bed-bfec-ddb3c321d441 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:49.970860 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ed2953de-5ccc-4bed-bfec-ddb3c321d441 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062590 Jul 14 11:49:49.971791 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 409/771] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:49:49 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:50.214453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-f45eb0f0-723c-4a37-898e-88625ccda0e9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:50.215689 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-f45eb0f0-723c-4a37-898e-88625ccda0e9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:50.224061 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f45eb0f0-723c-4a37-898e-88625ccda0e9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:50.224858 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f45eb0f0-723c-4a37-898e-88625ccda0e9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:50.225886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f45eb0f0-723c-4a37-898e-88625ccda0e9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:50.226506 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f45eb0f0-723c-4a37-898e-88625ccda0e9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:50.390799 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f45eb0f0-723c-4a37-898e-88625ccda0e9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:50.400434 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f45eb0f0-723c-4a37-898e-88625ccda0e9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:50.402365 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f45eb0f0-723c-4a37-898e-88625ccda0e9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:50.403830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-f45eb0f0-723c-4a37-898e-88625ccda0e9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1740 microversion: 2.20 time: 0.193324 Jul 14 11:49:50.404572 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 363/772] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:50 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:50.844827 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-192b33a5-a101-4bc2-bc0f-9bc4e9fdcde0 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:50.845700 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-192b33a5-a101-4bc2-bc0f-9bc4e9fdcde0 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:50.852329 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-192b33a5-a101-4bc2-bc0f-9bc4e9fdcde0 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:50.852801 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-192b33a5-a101-4bc2-bc0f-9bc4e9fdcde0 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:50.853742 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-192b33a5-a101-4bc2-bc0f-9bc4e9fdcde0 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:50.854173 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-192b33a5-a101-4bc2-bc0f-9bc4e9fdcde0 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:50.900282 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-192b33a5-a101-4bc2-bc0f-9bc4e9fdcde0 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054400 Jul 14 11:49:50.900282 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 410/773] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:49:50 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:50.907234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d31a3fa1-70d6-43d8-bb19-0490548bab48 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:50.907604 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d31a3fa1-70d6-43d8-bb19-0490548bab48 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:50.921115 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d31a3fa1-70d6-43d8-bb19-0490548bab48 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:50.921904 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d31a3fa1-70d6-43d8-bb19-0490548bab48 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:50.923430 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d31a3fa1-70d6-43d8-bb19-0490548bab48 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:50.924259 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d31a3fa1-70d6-43d8-bb19-0490548bab48 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:50.973482 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d31a3fa1-70d6-43d8-bb19-0490548bab48 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments/ae3b445b-9e46-48f0-9b06-7d3d33e8ff33" status: 200 len: 194 microversion: 2.1 time: 0.071561 Jul 14 11:49:50.974758 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 364/774] 10.222.0.40 () {58 vars in 1412 bytes} [Thu Jul 14 11:49:50 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments/ae3b445b-9e46-48f0-9b06-7d3d33e8ff33 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:50.987366 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ee591042-ac21-42df-997b-264666f20a6f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:50.987366 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ee591042-ac21-42df-997b-264666f20a6f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:50.997492 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ee591042-ac21-42df-997b-264666f20a6f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:50.998055 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ee591042-ac21-42df-997b-264666f20a6f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:50.999191 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ee591042-ac21-42df-997b-264666f20a6f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:50.999699 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ee591042-ac21-42df-997b-264666f20a6f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:51.038981 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ee591042-ac21-42df-997b-264666f20a6f tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056935 Jul 14 11:49:51.039571 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 411/775] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:49:50 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:51.423496 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9297077e-1f16-4657-a887-e144264722ae tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:51.424792 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9297077e-1f16-4657-a887-e144264722ae tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:51.432179 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9297077e-1f16-4657-a887-e144264722ae tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:51.432635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9297077e-1f16-4657-a887-e144264722ae tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:51.433981 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9297077e-1f16-4657-a887-e144264722ae tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:51.434418 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9297077e-1f16-4657-a887-e144264722ae tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:51.606111 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9297077e-1f16-4657-a887-e144264722ae tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:51.623105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9297077e-1f16-4657-a887-e144264722ae tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:51.625124 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9297077e-1f16-4657-a887-e144264722ae tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:51.629559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9297077e-1f16-4657-a887-e144264722ae tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1740 microversion: 2.20 time: 0.210120 Jul 14 11:49:51.633271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 365/776] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:51 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:52.052090 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ad5b6a0a-4c75-4788-b67f-ce4ab2a4410d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:52.053293 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ad5b6a0a-4c75-4788-b67f-ce4ab2a4410d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:52.061782 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ad5b6a0a-4c75-4788-b67f-ce4ab2a4410d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:52.062232 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ad5b6a0a-4c75-4788-b67f-ce4ab2a4410d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:52.063014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ad5b6a0a-4c75-4788-b67f-ce4ab2a4410d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:52.063452 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ad5b6a0a-4c75-4788-b67f-ce4ab2a4410d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:52.099575 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ad5b6a0a-4c75-4788-b67f-ce4ab2a4410d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051606 Jul 14 11:49:52.100213 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 412/777] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:49:52 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:49:52.177080 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e28c4a8b-5a01-4fa3-8914-1cb879b27ca6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:52.177607 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e28c4a8b-5a01-4fa3-8914-1cb879b27ca6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:52.184375 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e28c4a8b-5a01-4fa3-8914-1cb879b27ca6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:52.184833 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e28c4a8b-5a01-4fa3-8914-1cb879b27ca6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:52.185673 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e28c4a8b-5a01-4fa3-8914-1cb879b27ca6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:52.186116 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e28c4a8b-5a01-4fa3-8914-1cb879b27ca6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:52.212698 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e28c4a8b-5a01-4fa3-8914-1cb879b27ca6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Going to try to terminate instance {{(pid=124946) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:49:52.647377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b96aad4d-e6b8-47a9-b17b-89eb9f95f74d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:52.654795 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b96aad4d-e6b8-47a9-b17b-89eb9f95f74d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:52.659656 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b96aad4d-e6b8-47a9-b17b-89eb9f95f74d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:52.660289 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b96aad4d-e6b8-47a9-b17b-89eb9f95f74d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:52.661506 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b96aad4d-e6b8-47a9-b17b-89eb9f95f74d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:52.662214 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b96aad4d-e6b8-47a9-b17b-89eb9f95f74d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:52.815069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b96aad4d-e6b8-47a9-b17b-89eb9f95f74d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:52.823197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b96aad4d-e6b8-47a9-b17b-89eb9f95f74d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:52.825651 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b96aad4d-e6b8-47a9-b17b-89eb9f95f74d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:52.826839 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b96aad4d-e6b8-47a9-b17b-89eb9f95f74d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1740 microversion: 2.20 time: 0.183519 Jul 14 11:49:52.827403 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 413/778] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:52 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:49:52.832089 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-760191ff-27b6-4eb8-9874-994fbf8dc99c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ebd4418-e5e3-4dfb-b54c-537e3bca0f54"}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:49:52.833311 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-760191ff-27b6-4eb8-9874-994fbf8dc99c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:52.839867 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-760191ff-27b6-4eb8-9874-994fbf8dc99c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:52.842612 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-760191ff-27b6-4eb8-9874-994fbf8dc99c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:52.842612 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-760191ff-27b6-4eb8-9874-994fbf8dc99c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:52.842612 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-760191ff-27b6-4eb8-9874-994fbf8dc99c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:52.899541 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e28c4a8b-5a01-4fa3-8914-1cb879b27ca6 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 204 len: 0 microversion: 2.1 time: 0.725911 Jul 14 11:49:52.903258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 366/779] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:49:52 2022] DELETE /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:49:52.909053 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-67cda28e-abab-4d77-873c-d5128acab0ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:52.909888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-67cda28e-abab-4d77-873c-d5128acab0ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:52.916365 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-67cda28e-abab-4d77-873c-d5128acab0ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:52.916901 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-67cda28e-abab-4d77-873c-d5128acab0ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:52.918340 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-67cda28e-abab-4d77-873c-d5128acab0ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:52.918852 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-67cda28e-abab-4d77-873c-d5128acab0ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:53.065926 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-67cda28e-abab-4d77-873c-d5128acab0ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:53.068337 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:53.075923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-67cda28e-abab-4d77-873c-d5128acab0ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1688 microversion: 2.1 time: 0.171134 Jul 14 11:49:53.085576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 367/780] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:52 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:53.845563 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b4b0aebc-1603-41e7-81c8-7dfe724d4516 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:53.846547 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b4b0aebc-1603-41e7-81c8-7dfe724d4516 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:53.862141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b4b0aebc-1603-41e7-81c8-7dfe724d4516 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:53.871882 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b4b0aebc-1603-41e7-81c8-7dfe724d4516 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:53.873123 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b4b0aebc-1603-41e7-81c8-7dfe724d4516 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:53.873653 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b4b0aebc-1603-41e7-81c8-7dfe724d4516 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:54.038202 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b4b0aebc-1603-41e7-81c8-7dfe724d4516 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:54.048343 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b4b0aebc-1603-41e7-81c8-7dfe724d4516 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:54.049909 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b4b0aebc-1603-41e7-81c8-7dfe724d4516 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:54.051087 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b4b0aebc-1603-41e7-81c8-7dfe724d4516 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1740 microversion: 2.20 time: 0.209350 Jul 14 11:49:54.061877 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 368/781] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:53 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:54.092383 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-8441e6a6-1821-4aa3-a873-6d747a28207b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:54.093323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-8441e6a6-1821-4aa3-a873-6d747a28207b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:54.101583 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8441e6a6-1821-4aa3-a873-6d747a28207b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:54.102291 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8441e6a6-1821-4aa3-a873-6d747a28207b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:54.103263 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8441e6a6-1821-4aa3-a873-6d747a28207b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:54.103873 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8441e6a6-1821-4aa3-a873-6d747a28207b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:54.245220 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8441e6a6-1821-4aa3-a873-6d747a28207b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:54.253614 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-8441e6a6-1821-4aa3-a873-6d747a28207b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1688 microversion: 2.1 time: 0.164906 Jul 14 11:49:54.255776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 369/782] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:54 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:49:55.070434 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-8cf21a02-378c-42b2-bbf1-0bca43314628 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:55.071094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-8cf21a02-378c-42b2-bbf1-0bca43314628 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:55.078721 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8cf21a02-378c-42b2-bbf1-0bca43314628 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:55.079244 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8cf21a02-378c-42b2-bbf1-0bca43314628 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:55.080198 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8cf21a02-378c-42b2-bbf1-0bca43314628 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:55.081010 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8cf21a02-378c-42b2-bbf1-0bca43314628 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:55.227391 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8cf21a02-378c-42b2-bbf1-0bca43314628 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:55.236533 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8cf21a02-378c-42b2-bbf1-0bca43314628 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:55.238199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8cf21a02-378c-42b2-bbf1-0bca43314628 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:55.239734 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-8cf21a02-378c-42b2-bbf1-0bca43314628 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1740 microversion: 2.20 time: 0.173239 Jul 14 11:49:55.240309 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 370/783] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:55 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:49:55.271901 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5cd9f291-d0cf-45f3-9cab-6550f64821c5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:55.272774 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5cd9f291-d0cf-45f3-9cab-6550f64821c5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:55.279984 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5cd9f291-d0cf-45f3-9cab-6550f64821c5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:55.280437 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5cd9f291-d0cf-45f3-9cab-6550f64821c5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:55.281245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5cd9f291-d0cf-45f3-9cab-6550f64821c5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:55.281684 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5cd9f291-d0cf-45f3-9cab-6550f64821c5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:55.442474 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5cd9f291-d0cf-45f3-9cab-6550f64821c5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:55.452714 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5cd9f291-d0cf-45f3-9cab-6550f64821c5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1688 microversion: 2.1 time: 0.184991 Jul 14 11:49:55.453337 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 371/784] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:55 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:49:56.259171 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-8d8cdf13-d81a-47e7-bb66-7d32b6de4f75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:56.260293 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-8d8cdf13-d81a-47e7-bb66-7d32b6de4f75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:56.266384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8d8cdf13-d81a-47e7-bb66-7d32b6de4f75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:56.270520 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8d8cdf13-d81a-47e7-bb66-7d32b6de4f75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:56.270520 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8d8cdf13-d81a-47e7-bb66-7d32b6de4f75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:56.270520 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8d8cdf13-d81a-47e7-bb66-7d32b6de4f75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:56.429992 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8d8cdf13-d81a-47e7-bb66-7d32b6de4f75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:56.438315 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8d8cdf13-d81a-47e7-bb66-7d32b6de4f75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:56.444302 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8d8cdf13-d81a-47e7-bb66-7d32b6de4f75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:56.446240 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-8d8cdf13-d81a-47e7-bb66-7d32b6de4f75 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1740 microversion: 2.20 time: 0.191618 Jul 14 11:49:56.447034 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 372/785] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:56 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:56.471501 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-1e8589dd-ccd3-49fb-a9ac-be2639d5898a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:56.472124 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-1e8589dd-ccd3-49fb-a9ac-be2639d5898a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:56.478561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1e8589dd-ccd3-49fb-a9ac-be2639d5898a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:56.479013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1e8589dd-ccd3-49fb-a9ac-be2639d5898a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:56.479784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1e8589dd-ccd3-49fb-a9ac-be2639d5898a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:56.486065 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1e8589dd-ccd3-49fb-a9ac-be2639d5898a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:56.642962 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-1e8589dd-ccd3-49fb-a9ac-be2639d5898a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:56.651157 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-1e8589dd-ccd3-49fb-a9ac-be2639d5898a tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1688 microversion: 2.1 time: 0.183760 Jul 14 11:49:56.661213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 373/786] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:56 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:49:57.464001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9dd67ab9-6990-4f2c-9509-021e989fa0b9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:57.464769 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9dd67ab9-6990-4f2c-9509-021e989fa0b9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:57.471501 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9dd67ab9-6990-4f2c-9509-021e989fa0b9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:57.472038 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9dd67ab9-6990-4f2c-9509-021e989fa0b9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:57.473335 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9dd67ab9-6990-4f2c-9509-021e989fa0b9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:57.473335 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9dd67ab9-6990-4f2c-9509-021e989fa0b9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:57.577407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-760191ff-27b6-4eb8-9874-994fbf8dc99c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "POST /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.748750 Jul 14 11:49:57.578201 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 414/787] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 11:49:52 2022] POST /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments => generated 194 bytes in 4750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:57.643421 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9dd67ab9-6990-4f2c-9509-021e989fa0b9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:57.651554 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9dd67ab9-6990-4f2c-9509-021e989fa0b9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:57.658056 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9dd67ab9-6990-4f2c-9509-021e989fa0b9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:57.658056 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9dd67ab9-6990-4f2c-9509-021e989fa0b9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1740 microversion: 2.20 time: 0.194389 Jul 14 11:49:57.658056 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 374/788] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:57 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:49:57.670246 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8b81b523-1c43-4026-b996-0bdc1680f0d9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:57.670991 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-8b81b523-1c43-4026-b996-0bdc1680f0d9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:57.680185 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8b81b523-1c43-4026-b996-0bdc1680f0d9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:57.680642 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8b81b523-1c43-4026-b996-0bdc1680f0d9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:57.681494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8b81b523-1c43-4026-b996-0bdc1680f0d9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:57.681937 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8b81b523-1c43-4026-b996-0bdc1680f0d9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:57.698371 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:57.754036 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-8b81b523-1c43-4026-b996-0bdc1680f0d9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:57.762055 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-8b81b523-1c43-4026-b996-0bdc1680f0d9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1621 microversion: 2.1 time: 0.096836 Jul 14 11:49:57.762733 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 415/789] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:57 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1621 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:49:58.392945 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-3cc5e5bb-6644-4901-a490-609cb9d13af5 req-21f97d18-15ca-4e31-af43-350dfb17720a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c667180-b390-45de-b693-7d59b8369eb6", "name": "network-vif-deleted", "tag": "941e85d3-a14c-4664-99a5-c7fce2347e18"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:49:58.413225 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-3cc5e5bb-6644-4901-a490-609cb9d13af5 req-21f97d18-15ca-4e31-af43-350dfb17720a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:58.415423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-3cc5e5bb-6644-4901-a490-609cb9d13af5 req-21f97d18-15ca-4e31-af43-350dfb17720a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:58.437584 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-3cc5e5bb-6644-4901-a490-609cb9d13af5 req-21f97d18-15ca-4e31-af43-350dfb17720a service nova] Creating event network-vif-deleted:941e85d3-a14c-4664-99a5-c7fce2347e18 for instance 1c667180-b390-45de-b693-7d59b8369eb6 on hv-cinder-84980 Jul 14 11:49:58.442577 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-3cc5e5bb-6644-4901-a490-609cb9d13af5 req-21f97d18-15ca-4e31-af43-350dfb17720a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153076 Jul 14 11:49:58.443585 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 375/790] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:58.681725 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-81c5277b-1017-4e8a-95da-da5b0db7aa3e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:58.682350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-81c5277b-1017-4e8a-95da-da5b0db7aa3e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:58.685908 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=50 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:49:58.691444 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-81c5277b-1017-4e8a-95da-da5b0db7aa3e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:58.691966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-81c5277b-1017-4e8a-95da-da5b0db7aa3e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:58.692822 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-81c5277b-1017-4e8a-95da-da5b0db7aa3e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:58.693364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-81c5277b-1017-4e8a-95da-da5b0db7aa3e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:58.780195 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e7c99a7b-3278-47ee-83a9-3e6b3e9f73fd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:58.781325 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e7c99a7b-3278-47ee-83a9-3e6b3e9f73fd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:58.788267 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e7c99a7b-3278-47ee-83a9-3e6b3e9f73fd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:58.789041 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e7c99a7b-3278-47ee-83a9-3e6b3e9f73fd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:58.790067 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e7c99a7b-3278-47ee-83a9-3e6b3e9f73fd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:58.790659 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e7c99a7b-3278-47ee-83a9-3e6b3e9f73fd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:58.830011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e7c99a7b-3278-47ee-83a9-3e6b3e9f73fd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:58.830695 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e7c99a7b-3278-47ee-83a9-3e6b3e9f73fd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:58.835210 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-81c5277b-1017-4e8a-95da-da5b0db7aa3e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:58.837767 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-e7c99a7b-3278-47ee-83a9-3e6b3e9f73fd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lazy-loading 'fault' on Instance uuid 1c667180-b390-45de-b693-7d59b8369eb6 {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:49:58.844944 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-81c5277b-1017-4e8a-95da-da5b0db7aa3e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:58.846815 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-81c5277b-1017-4e8a-95da-da5b0db7aa3e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:58.848249 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-81c5277b-1017-4e8a-95da-da5b0db7aa3e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1722 microversion: 2.20 time: 0.170759 Jul 14 11:49:58.859546 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 416/791] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:58 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:49:58.912402 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e7c99a7b-3278-47ee-83a9-3e6b3e9f73fd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:49:58.920927 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e7c99a7b-3278-47ee-83a9-3e6b3e9f73fd tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1335 microversion: 2.1 time: 0.145692 Jul 14 11:49:58.921535 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 376/792] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:58 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1335 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:49:59.794701 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-69c700a6-43ca-4c47-a03c-a842da444f30 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:59.795373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-69c700a6-43ca-4c47-a03c-a842da444f30 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:59.801335 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-69c700a6-43ca-4c47-a03c-a842da444f30 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:59.801785 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-69c700a6-43ca-4c47-a03c-a842da444f30 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:59.802559 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-69c700a6-43ca-4c47-a03c-a842da444f30 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:59.802999 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-69c700a6-43ca-4c47-a03c-a842da444f30 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:59.826195 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-69c700a6-43ca-4c47-a03c-a842da444f30 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/ips" status: 200 len: 149 microversion: 2.1 time: 0.086604 Jul 14 11:49:59.826742 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 417/793] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 11:49:59 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/ips => generated 149 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:49:59.871603 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9b05dd48-54ab-4e48-ad34-738419801be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:59.872285 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9b05dd48-54ab-4e48-ad34-738419801be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:59.878832 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9b05dd48-54ab-4e48-ad34-738419801be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:59.879342 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9b05dd48-54ab-4e48-ad34-738419801be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:59.880173 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9b05dd48-54ab-4e48-ad34-738419801be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:59.880611 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9b05dd48-54ab-4e48-ad34-738419801be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:59.938003 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9b59ee5c-6f89-4220-8866-e8b94e05decc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:49:59.938618 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9b59ee5c-6f89-4220-8866-e8b94e05decc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:49:59.944742 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9b59ee5c-6f89-4220-8866-e8b94e05decc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:59.945115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9b59ee5c-6f89-4220-8866-e8b94e05decc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:59.946145 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9b59ee5c-6f89-4220-8866-e8b94e05decc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:59.946764 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9b59ee5c-6f89-4220-8866-e8b94e05decc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:59.979513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9b59ee5c-6f89-4220-8866-e8b94e05decc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:49:59.980060 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9b59ee5c-6f89-4220-8866-e8b94e05decc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:49:59.980580 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-9b59ee5c-6f89-4220-8866-e8b94e05decc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lazy-loading 'fault' on Instance uuid 1c667180-b390-45de-b693-7d59b8369eb6 {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:50:00.017447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9b05dd48-54ab-4e48-ad34-738419801be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:00.026836 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9b59ee5c-6f89-4220-8866-e8b94e05decc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:00.029062 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9b05dd48-54ab-4e48-ad34-738419801be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:00.030612 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9b05dd48-54ab-4e48-ad34-738419801be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:00.031832 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9b05dd48-54ab-4e48-ad34-738419801be5 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1722 microversion: 2.20 time: 0.164288 Jul 14 11:50:00.037199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 377/794] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:49:59 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:00.037377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9b59ee5c-6f89-4220-8866-e8b94e05decc tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1335 microversion: 2.1 time: 0.100462 Jul 14 11:50:00.037377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 418/795] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:49:59 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1335 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:50:01.049965 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-18b36698-0997-4dfb-bdf4-7bd39a619fd1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:01.050594 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-18b36698-0997-4dfb-bdf4-7bd39a619fd1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:01.051210 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-fc4217ad-0ece-4959-ac9d-36bb2c92a0d4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:01.051860 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-fc4217ad-0ece-4959-ac9d-36bb2c92a0d4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:01.057585 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-18b36698-0997-4dfb-bdf4-7bd39a619fd1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:01.058039 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-18b36698-0997-4dfb-bdf4-7bd39a619fd1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:01.058530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fc4217ad-0ece-4959-ac9d-36bb2c92a0d4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:01.058962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fc4217ad-0ece-4959-ac9d-36bb2c92a0d4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:01.059081 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-18b36698-0997-4dfb-bdf4-7bd39a619fd1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:01.059453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-18b36698-0997-4dfb-bdf4-7bd39a619fd1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:01.060458 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fc4217ad-0ece-4959-ac9d-36bb2c92a0d4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:01.060949 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fc4217ad-0ece-4959-ac9d-36bb2c92a0d4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:01.097541 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fc4217ad-0ece-4959-ac9d-36bb2c92a0d4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:01.098076 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fc4217ad-0ece-4959-ac9d-36bb2c92a0d4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:01.098539 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-fc4217ad-0ece-4959-ac9d-36bb2c92a0d4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lazy-loading 'fault' on Instance uuid 1c667180-b390-45de-b693-7d59b8369eb6 {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:50:01.149988 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-fc4217ad-0ece-4959-ac9d-36bb2c92a0d4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:01.159425 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-fc4217ad-0ece-4959-ac9d-36bb2c92a0d4 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 200 len: 1335 microversion: 2.1 time: 0.111466 Jul 14 11:50:01.159425 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 419/796] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:01 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:50:01.208488 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-18b36698-0997-4dfb-bdf4-7bd39a619fd1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:01.217097 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-18b36698-0997-4dfb-bdf4-7bd39a619fd1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:01.218656 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-18b36698-0997-4dfb-bdf4-7bd39a619fd1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:01.219808 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-18b36698-0997-4dfb-bdf4-7bd39a619fd1 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1722 microversion: 2.20 time: 0.174024 Jul 14 11:50:01.220358 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 378/797] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:01 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:01.349377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-c727f254-96de-4416-ac39-e32e3d2edf35 req-aad8f698-31fb-4a07-a52f-1744886a8cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08c817f-cc75-4c71-8645-51a7a1938404", "name": "network-vif-unplugged", "status": "completed", "tag": "5c8aa46b-5efe-4ab3-b31e-03775de21303"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:01.359792 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-c727f254-96de-4416-ac39-e32e3d2edf35 req-aad8f698-31fb-4a07-a52f-1744886a8cb8 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:01.360255 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-c727f254-96de-4416-ac39-e32e3d2edf35 req-aad8f698-31fb-4a07-a52f-1744886a8cb8 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:01.372399 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-c727f254-96de-4416-ac39-e32e3d2edf35 req-aad8f698-31fb-4a07-a52f-1744886a8cb8 service nova] Creating event network-vif-unplugged:5c8aa46b-5efe-4ab3-b31e-03775de21303 for instance e08c817f-cc75-4c71-8645-51a7a1938404 on hv-cinder-84980 Jul 14 11:50:01.377337 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-c727f254-96de-4416-ac39-e32e3d2edf35 req-aad8f698-31fb-4a07-a52f-1744886a8cb8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031659 Jul 14 11:50:01.377935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 420/798] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:01.455286 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b0e8f606-52a1-4d1f-aa42-8e52f1f28645 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4c97e85-d5b5-4c11-8b01-a17427e6b261"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:01.456411 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b0e8f606-52a1-4d1f-aa42-8e52f1f28645 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:01.462893 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b0e8f606-52a1-4d1f-aa42-8e52f1f28645 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:01.463345 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b0e8f606-52a1-4d1f-aa42-8e52f1f28645 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:01.464124 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b0e8f606-52a1-4d1f-aa42-8e52f1f28645 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:01.464570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b0e8f606-52a1-4d1f-aa42-8e52f1f28645 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:02.176269 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1d62176e-c396-4671-9462-99c050fbd7aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:02.177079 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1d62176e-c396-4671-9462-99c050fbd7aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 1c667180-b390-45de-b693-7d59b8369eb6] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:02.184187 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1d62176e-c396-4671-9462-99c050fbd7aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:02.184637 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1d62176e-c396-4671-9462-99c050fbd7aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:02.185657 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1d62176e-c396-4671-9462-99c050fbd7aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:02.186383 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1d62176e-c396-4671-9462-99c050fbd7aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:02.208671 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-1d62176e-c396-4671-9462-99c050fbd7aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] HTTP exception thrown: Instance 1c667180-b390-45de-b693-7d59b8369eb6 could not be found. Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1d62176e-c396-4671-9462-99c050fbd7aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Request method failure captured: Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 HTTP/1.1 Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AHQD1ds0B25g5a12RFZgJ1X93Ad5kZKaW0a1WjTLos6WW0CS6889iadn7zLg9bxO6vFXCGcHydQ85EksLgMo8lXHCJEJA7JIza9eewxu56JoCts8WylfsrATjwEt9XaewZT3n2T3tUxjz2Qgf3sANPTml-AV6YyBO2MzgTVNMnGeHI Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 951609a482e34e93908057a68c5dc706 Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-954968877 Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:50:02.210373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:50:02.211894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/951609a482e34e93908057a68c5dc706"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_951609a482e34e93908057a68c5dc706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/951609a482e34e93908057a68c5dc706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/951609a482e34e93908057a68c5dc706"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:02.211894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-ServerRescueNegativeTestJSON-954968877 Jul 14 11:50:02.211894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 951609a482e34e93908057a68c5dc706 Jul 14 11:50:02.211894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-954968877 Jul 14 11:50:02.211894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-ServerRescueNegativeTestJSON-954968877-project Jul 14 11:50:02.211894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:50:02.211894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:50:02.211894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 7bf3f705e04640a2a5d9bedb71c6ccb5 Jul 14 11:50:02.211894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-ServerRescueNegativeTestJSON-954968877-project Jul 14 11:50:02.211894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:50:02.211894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance 1c667180-b390-45de-b693-7d59b8369eb6 could not be found. Jul 14 11:50:02.211894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': '1c667180-b390-45de-b693-7d59b8369eb6'} Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c667180-b390-45de-b693-7d59b8369eb6 could not be found. Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:02.213102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c667180-b390-45de-b693-7d59b8369eb6 could not be found. Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c667180-b390-45de-b693-7d59b8369eb6 could not be found. Jul 14 11:50:02.214553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:02.216014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1d62176e-c396-4671-9462-99c050fbd7aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Returning 404 to user: Instance 1c667180-b390-45de-b693-7d59b8369eb6 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:02.216014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1d62176e-c396-4671-9462-99c050fbd7aa tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6" status: 404 len: 111 microversion: 2.1 time: 0.040348 Jul 14 11:50:02.216014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 421/799] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:02 2022] GET /compute/v2.1/servers/1c667180-b390-45de-b693-7d59b8369eb6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:50:02.220876 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-eeb96e07-763a-4dfa-a567-dc7af3393203 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '.version_select at 0x7f1adf63b310>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:02.312036 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-eeb96e07-763a-4dfa-a567-dc7af3393203 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2146376758" status: 202 len: 0 microversion: 2.1 time: 0.094742 Jul 14 11:50:02.312521 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 422/800] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jul 14 11:50:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2146376758 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:50:02.317866 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d11ee084-bc3e-4a99-a240-c57833c366eb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:02.318246 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d11ee084-bc3e-4a99-a240-c57833c366eb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:02.324539 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d11ee084-bc3e-4a99-a240-c57833c366eb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:02.324991 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d11ee084-bc3e-4a99-a240-c57833c366eb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:02.325878 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d11ee084-bc3e-4a99-a240-c57833c366eb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:02.326319 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d11ee084-bc3e-4a99-a240-c57833c366eb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:02.501196 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b0e8f606-52a1-4d1f-aa42-8e52f1f28645 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "POST /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.049545 Jul 14 11:50:02.507072 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 379/801] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 11:50:01 2022] POST /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/os-volume_attachments => generated 194 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:02.532492 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d11ee084-bc3e-4a99-a240-c57833c366eb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:02.541913 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d11ee084-bc3e-4a99-a240-c57833c366eb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:02.546416 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d11ee084-bc3e-4a99-a240-c57833c366eb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:02.547734 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d11ee084-bc3e-4a99-a240-c57833c366eb tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1665 microversion: 2.20 time: 0.234071 Jul 14 11:50:02.548406 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 423/802] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:02 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1665 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:02.569022 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-74fac405-a52a-4c18-8f45-2e14e7fdf716 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "001d6670-0acb-4f1d-839e-f314cef0c640"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:02.570146 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-74fac405-a52a-4c18-8f45-2e14e7fdf716 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:02.576421 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-74fac405-a52a-4c18-8f45-2e14e7fdf716 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:02.576868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-74fac405-a52a-4c18-8f45-2e14e7fdf716 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:02.577655 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-74fac405-a52a-4c18-8f45-2e14e7fdf716 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:02.578087 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-74fac405-a52a-4c18-8f45-2e14e7fdf716 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:03.461998 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:03.536544 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-74fac405-a52a-4c18-8f45-2e14e7fdf716 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "POST /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.972032 Jul 14 11:50:03.537827 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 380/803] 10.222.0.40 () {62 vars in 1363 bytes} [Thu Jul 14 11:50:02 2022] POST /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404/os-volume_attachments => generated 188 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:50:03.652197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9e688dd2-0535-43eb-b681-d6374c5f6532 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:03.652769 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9e688dd2-0535-43eb-b681-d6374c5f6532 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:03.659839 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9e688dd2-0535-43eb-b681-d6374c5f6532 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:03.660295 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9e688dd2-0535-43eb-b681-d6374c5f6532 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:03.661090 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9e688dd2-0535-43eb-b681-d6374c5f6532 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:03.661669 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9e688dd2-0535-43eb-b681-d6374c5f6532 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:04.193617 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9e688dd2-0535-43eb-b681-d6374c5f6532 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404/os-volume_attachments/001d6670-0acb-4f1d-839e-f314cef0c640" status: 202 len: 0 microversion: 2.20 time: 0.545256 Jul 14 11:50:04.194175 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 424/804] 10.222.0.40 () {60 vars in 1456 bytes} [Thu Jul 14 11:50:03 2022] DELETE /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404/os-volume_attachments/001d6670-0acb-4f1d-839e-f314cef0c640 => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:50:04.251456 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-461d939f-c04a-4dc2-88d2-ae490ff8eccf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:04.252045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-461d939f-c04a-4dc2-88d2-ae490ff8eccf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:04.259636 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-461d939f-c04a-4dc2-88d2-ae490ff8eccf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:04.263740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-461d939f-c04a-4dc2-88d2-ae490ff8eccf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:04.263740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-461d939f-c04a-4dc2-88d2-ae490ff8eccf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:04.263740 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-461d939f-c04a-4dc2-88d2-ae490ff8eccf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:04.512338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-461d939f-c04a-4dc2-88d2-ae490ff8eccf tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "POST /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404/action" status: 202 len: 0 microversion: 2.20 time: 0.265673 Jul 14 11:50:04.513246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 381/805] 10.222.0.40 () {62 vars in 1318 bytes} [Thu Jul 14 11:50:04 2022] POST /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:50:04.521722 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7065c380-7c29-40bb-a287-28bfc8b0bf1f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:04.522620 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7065c380-7c29-40bb-a287-28bfc8b0bf1f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:04.530008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7065c380-7c29-40bb-a287-28bfc8b0bf1f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:04.530450 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7065c380-7c29-40bb-a287-28bfc8b0bf1f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:04.531224 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7065c380-7c29-40bb-a287-28bfc8b0bf1f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:04.531659 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7065c380-7c29-40bb-a287-28bfc8b0bf1f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:04.677582 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7065c380-7c29-40bb-a287-28bfc8b0bf1f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:04.694715 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7065c380-7c29-40bb-a287-28bfc8b0bf1f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:04.696182 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7065c380-7c29-40bb-a287-28bfc8b0bf1f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:04.697522 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7065c380-7c29-40bb-a287-28bfc8b0bf1f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1673 microversion: 2.20 time: 0.179782 Jul 14 11:50:04.698034 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 425/806] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:04 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1673 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:05.718218 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d13d75af-9ee0-4b89-bb32-76675e70b5ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:05.719501 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d13d75af-9ee0-4b89-bb32-76675e70b5ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:05.722126 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:05.727697 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d13d75af-9ee0-4b89-bb32-76675e70b5ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:05.728176 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d13d75af-9ee0-4b89-bb32-76675e70b5ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:05.728897 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d13d75af-9ee0-4b89-bb32-76675e70b5ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:05.729355 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d13d75af-9ee0-4b89-bb32-76675e70b5ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:05.732312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-822af707-0c11-4a81-87ca-872759ab3a11 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:05.733424 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-822af707-0c11-4a81-87ca-872759ab3a11 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:05.740871 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-822af707-0c11-4a81-87ca-872759ab3a11 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:05.741448 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-822af707-0c11-4a81-87ca-872759ab3a11 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:05.742469 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-822af707-0c11-4a81-87ca-872759ab3a11 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:05.742996 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-822af707-0c11-4a81-87ca-872759ab3a11 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:05.770619 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-822af707-0c11-4a81-87ca-872759ab3a11 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Going to try to terminate instance {{(pid=124947) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:50:05.875121 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d13d75af-9ee0-4b89-bb32-76675e70b5ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:05.883401 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d13d75af-9ee0-4b89-bb32-76675e70b5ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:05.884985 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d13d75af-9ee0-4b89-bb32-76675e70b5ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:05.886330 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d13d75af-9ee0-4b89-bb32-76675e70b5ed tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1673 microversion: 2.20 time: 0.173186 Jul 14 11:50:05.887231 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 382/807] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:05 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:06.074558 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-822af707-0c11-4a81-87ca-872759ab3a11 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "DELETE /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 204 len: 0 microversion: 2.1 time: 0.347653 Jul 14 11:50:06.075381 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 426/808] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:50:05 2022] DELETE /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:50:06.086325 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d4ca479c-1b74-418c-a59f-97cb91758ef9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:06.086325 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d4ca479c-1b74-418c-a59f-97cb91758ef9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:06.090692 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d4ca479c-1b74-418c-a59f-97cb91758ef9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:06.091136 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d4ca479c-1b74-418c-a59f-97cb91758ef9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:06.091882 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d4ca479c-1b74-418c-a59f-97cb91758ef9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:06.092313 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d4ca479c-1b74-418c-a59f-97cb91758ef9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:06.221368 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d4ca479c-1b74-418c-a59f-97cb91758ef9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:06.229281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d4ca479c-1b74-418c-a59f-97cb91758ef9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1508 microversion: 2.1 time: 0.149796 Jul 14 11:50:06.229855 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 383/809] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:06 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:06.285559 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-71792c24-19e5-4c88-81b4-516b86aae728 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:06.289946 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-71792c24-19e5-4c88-81b4-516b86aae728 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:06.292602 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-71792c24-19e5-4c88-81b4-516b86aae728 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:06.293041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-71792c24-19e5-4c88-81b4-516b86aae728 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:06.294397 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-71792c24-19e5-4c88-81b4-516b86aae728 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:06.294834 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-71792c24-19e5-4c88-81b4-516b86aae728 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:06.327709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-71792c24-19e5-4c88-81b4-516b86aae728 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046451 Jul 14 11:50:06.328182 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 427/810] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:50:06 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:06.480950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-45dd2dd8-6d11-4edb-b10c-41f6a8a94b03 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:06.481460 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-45dd2dd8-6d11-4edb-b10c-41f6a8a94b03 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:06.487704 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-45dd2dd8-6d11-4edb-b10c-41f6a8a94b03 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:06.488194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-45dd2dd8-6d11-4edb-b10c-41f6a8a94b03 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:06.489610 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-45dd2dd8-6d11-4edb-b10c-41f6a8a94b03 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:06.490513 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-45dd2dd8-6d11-4edb-b10c-41f6a8a94b03 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:06.523255 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-45dd2dd8-6d11-4edb-b10c-41f6a8a94b03 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments/ae3b445b-9e46-48f0-9b06-7d3d33e8ff33" status: 200 len: 194 microversion: 2.1 time: 0.046234 Jul 14 11:50:06.523853 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 384/811] 10.222.0.40 () {58 vars in 1412 bytes} [Thu Jul 14 11:50:06 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments/ae3b445b-9e46-48f0-9b06-7d3d33e8ff33 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:06.534459 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8f2ba6b2-3b96-418f-bce4-c8fb17d6b123 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:06.535008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-8f2ba6b2-3b96-418f-bce4-c8fb17d6b123 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:06.541278 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8f2ba6b2-3b96-418f-bce4-c8fb17d6b123 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:06.541718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8f2ba6b2-3b96-418f-bce4-c8fb17d6b123 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:06.551847 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8f2ba6b2-3b96-418f-bce4-c8fb17d6b123 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:06.551847 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8f2ba6b2-3b96-418f-bce4-c8fb17d6b123 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:06.630017 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-8f2ba6b2-3b96-418f-bce4-c8fb17d6b123 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lazy-loading 'services' on Instance uuid 4a9a7ce6-aede-493e-8e91-b35f4c51d954 {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:50:06.842933 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-8f2ba6b2-3b96-418f-bce4-c8fb17d6b123 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments/ae3b445b-9e46-48f0-9b06-7d3d33e8ff33" status: 202 len: 0 microversion: 2.1 time: 0.312283 Jul 14 11:50:06.843665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 428/812] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 11:50:06 2022] DELETE /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments/ae3b445b-9e46-48f0-9b06-7d3d33e8ff33 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:50:06.906168 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b0632705-c22e-47c0-a155-f76b179350db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:06.908008 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b0632705-c22e-47c0-a155-f76b179350db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:06.914728 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b0632705-c22e-47c0-a155-f76b179350db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:06.915336 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b0632705-c22e-47c0-a155-f76b179350db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:06.916112 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b0632705-c22e-47c0-a155-f76b179350db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:06.916553 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b0632705-c22e-47c0-a155-f76b179350db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:07.056717 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b0632705-c22e-47c0-a155-f76b179350db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:07.065489 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b0632705-c22e-47c0-a155-f76b179350db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:07.067038 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b0632705-c22e-47c0-a155-f76b179350db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:07.068216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b0632705-c22e-47c0-a155-f76b179350db tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1675 microversion: 2.20 time: 0.168100 Jul 14 11:50:07.068771 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 385/813] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:06 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:07.248109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a6dbf14e-9dc0-423d-8d27-e117890bf377 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:07.248829 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a6dbf14e-9dc0-423d-8d27-e117890bf377 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:07.255523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a6dbf14e-9dc0-423d-8d27-e117890bf377 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:07.255958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a6dbf14e-9dc0-423d-8d27-e117890bf377 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:07.256718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a6dbf14e-9dc0-423d-8d27-e117890bf377 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:07.257145 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a6dbf14e-9dc0-423d-8d27-e117890bf377 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:07.261437 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:07.391823 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a6dbf14e-9dc0-423d-8d27-e117890bf377 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:07.399623 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a6dbf14e-9dc0-423d-8d27-e117890bf377 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1508 microversion: 2.1 time: 0.155979 Jul 14 11:50:07.400204 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 429/814] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:07 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:08.088507 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-f1acd873-eebb-47db-88e2-8355676611ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:08.089198 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-f1acd873-eebb-47db-88e2-8355676611ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:08.095530 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f1acd873-eebb-47db-88e2-8355676611ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:08.095977 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f1acd873-eebb-47db-88e2-8355676611ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:08.096754 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f1acd873-eebb-47db-88e2-8355676611ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:08.097222 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f1acd873-eebb-47db-88e2-8355676611ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:08.234332 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f1acd873-eebb-47db-88e2-8355676611ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:08.242501 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f1acd873-eebb-47db-88e2-8355676611ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:08.244019 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f1acd873-eebb-47db-88e2-8355676611ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:08.245208 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-f1acd873-eebb-47db-88e2-8355676611ef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1675 microversion: 2.20 time: 0.161331 Jul 14 11:50:08.245792 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 386/815] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:08 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:08.417608 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f66e6c89-a7cb-42a3-8b3a-3296442fbaf8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:08.420701 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f66e6c89-a7cb-42a3-8b3a-3296442fbaf8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:08.427812 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f66e6c89-a7cb-42a3-8b3a-3296442fbaf8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:08.428261 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f66e6c89-a7cb-42a3-8b3a-3296442fbaf8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:08.429036 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f66e6c89-a7cb-42a3-8b3a-3296442fbaf8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:08.429497 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f66e6c89-a7cb-42a3-8b3a-3296442fbaf8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:08.567035 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f66e6c89-a7cb-42a3-8b3a-3296442fbaf8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:08.575075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f66e6c89-a7cb-42a3-8b3a-3296442fbaf8 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1508 microversion: 2.1 time: 0.161312 Jul 14 11:50:08.575643 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 430/816] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:08 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:08.919847 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-35ccfa6e-9563-4449-831c-9b6aab8b6d32 req-03b24971-cbbc-44cb-91b8-5158328312f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58800231-da1d-4abc-a4e9-76999be20567", "name": "network-vif-deleted", "tag": "cfabf88c-ae26-4c85-af20-c102b65a3c9b"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:08.930942 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-35ccfa6e-9563-4449-831c-9b6aab8b6d32 req-03b24971-cbbc-44cb-91b8-5158328312f0 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:08.931462 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-35ccfa6e-9563-4449-831c-9b6aab8b6d32 req-03b24971-cbbc-44cb-91b8-5158328312f0 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:08.945088 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-35ccfa6e-9563-4449-831c-9b6aab8b6d32 req-03b24971-cbbc-44cb-91b8-5158328312f0 service nova] Creating event network-vif-deleted:cfabf88c-ae26-4c85-af20-c102b65a3c9b for instance 58800231-da1d-4abc-a4e9-76999be20567 on hv-cinder-84980 Jul 14 11:50:08.960846 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-35ccfa6e-9563-4449-831c-9b6aab8b6d32 req-03b24971-cbbc-44cb-91b8-5158328312f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045797 Jul 14 11:50:08.961649 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 387/817] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:09.270370 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-0b8a5ee8-3ab0-47f8-8b4f-7f3f7cf1b209 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:09.271101 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-0b8a5ee8-3ab0-47f8-8b4f-7f3f7cf1b209 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:09.277855 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0b8a5ee8-3ab0-47f8-8b4f-7f3f7cf1b209 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:09.278553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0b8a5ee8-3ab0-47f8-8b4f-7f3f7cf1b209 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:09.279374 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0b8a5ee8-3ab0-47f8-8b4f-7f3f7cf1b209 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:09.279811 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0b8a5ee8-3ab0-47f8-8b4f-7f3f7cf1b209 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:09.420712 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-0b8a5ee8-3ab0-47f8-8b4f-7f3f7cf1b209 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:09.428864 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-0b8a5ee8-3ab0-47f8-8b4f-7f3f7cf1b209 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:09.430411 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-0b8a5ee8-3ab0-47f8-8b4f-7f3f7cf1b209 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:09.431565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-0b8a5ee8-3ab0-47f8-8b4f-7f3f7cf1b209 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.165259 Jul 14 11:50:09.432121 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 431/818] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:09 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:09.594464 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ae3b7b02-f987-4bfb-bf40-cc1042b1a4cf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:09.595201 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ae3b7b02-f987-4bfb-bf40-cc1042b1a4cf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:09.601695 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ae3b7b02-f987-4bfb-bf40-cc1042b1a4cf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:09.602146 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ae3b7b02-f987-4bfb-bf40-cc1042b1a4cf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:09.602873 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ae3b7b02-f987-4bfb-bf40-cc1042b1a4cf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:09.603317 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ae3b7b02-f987-4bfb-bf40-cc1042b1a4cf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:09.635718 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ae3b7b02-f987-4bfb-bf40-cc1042b1a4cf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:09.636168 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ae3b7b02-f987-4bfb-bf40-cc1042b1a4cf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:09.636620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-ae3b7b02-f987-4bfb-bf40-cc1042b1a4cf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lazy-loading 'fault' on Instance uuid 58800231-da1d-4abc-a4e9-76999be20567 {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:50:09.678615 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ae3b7b02-f987-4bfb-bf40-cc1042b1a4cf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:09.686720 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ae3b7b02-f987-4bfb-bf40-cc1042b1a4cf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 200 len: 1312 microversion: 2.1 time: 0.097262 Jul 14 11:50:09.687294 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 388/819] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:09 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:10.450075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-34f35630-3251-42e3-8ed6-3479cf335117 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:10.450603 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-34f35630-3251-42e3-8ed6-3479cf335117 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:10.458080 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-34f35630-3251-42e3-8ed6-3479cf335117 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:10.458593 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-34f35630-3251-42e3-8ed6-3479cf335117 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:10.459359 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-34f35630-3251-42e3-8ed6-3479cf335117 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:10.459974 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-34f35630-3251-42e3-8ed6-3479cf335117 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:10.598915 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-34f35630-3251-42e3-8ed6-3479cf335117 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:10.609745 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-34f35630-3251-42e3-8ed6-3479cf335117 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:10.611360 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-34f35630-3251-42e3-8ed6-3479cf335117 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:10.612608 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-34f35630-3251-42e3-8ed6-3479cf335117 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.166525 Jul 14 11:50:10.613257 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 432/820] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:10 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:10.708296 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3ab58cdf-00da-4b82-870d-0b70bc238777 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:10.708883 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3ab58cdf-00da-4b82-870d-0b70bc238777 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 58800231-da1d-4abc-a4e9-76999be20567] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:10.715827 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3ab58cdf-00da-4b82-870d-0b70bc238777 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:10.716285 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3ab58cdf-00da-4b82-870d-0b70bc238777 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:10.717721 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3ab58cdf-00da-4b82-870d-0b70bc238777 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:10.718075 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3ab58cdf-00da-4b82-870d-0b70bc238777 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:10.733762 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-3ab58cdf-00da-4b82-870d-0b70bc238777 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] HTTP exception thrown: Instance 58800231-da1d-4abc-a4e9-76999be20567 could not be found. Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3ab58cdf-00da-4b82-870d-0b70bc238777 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Request method failure captured: Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 HTTP/1.1 Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AHQD1ds0B25g5a12RFZgJ1X93Ad5kZKaW0a1WjTLos6WW0CS6889iadn7zLg9bxO6vFXCGcHydQ85EksLgMo8lXHCJEJA7JIza9eewxu56JoCts8WylfsrATjwEt9XaewZT3n2T3tUxjz2Qgf3sANPTml-AV6YyBO2MzgTVNMnGeHI Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 951609a482e34e93908057a68c5dc706 Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-954968877 Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:50:10.735442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:50:10.737120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/951609a482e34e93908057a68c5dc706"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_951609a482e34e93908057a68c5dc706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/951609a482e34e93908057a68c5dc706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/951609a482e34e93908057a68c5dc706"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:10.737120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-ServerRescueNegativeTestJSON-954968877 Jul 14 11:50:10.737120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 951609a482e34e93908057a68c5dc706 Jul 14 11:50:10.737120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-954968877 Jul 14 11:50:10.737120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-ServerRescueNegativeTestJSON-954968877-project Jul 14 11:50:10.737120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:50:10.737120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:50:10.737120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 7bf3f705e04640a2a5d9bedb71c6ccb5 Jul 14 11:50:10.737120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-ServerRescueNegativeTestJSON-954968877-project Jul 14 11:50:10.737120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:50:10.737120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 58800231-da1d-4abc-a4e9-76999be20567 could not be found. Jul 14 11:50:10.737120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '58800231-da1d-4abc-a4e9-76999be20567'} Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58800231-da1d-4abc-a4e9-76999be20567 could not be found. Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:10.738001 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58800231-da1d-4abc-a4e9-76999be20567 could not be found. Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58800231-da1d-4abc-a4e9-76999be20567 could not be found. Jul 14 11:50:10.739453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:10.740606 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3ab58cdf-00da-4b82-870d-0b70bc238777 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Returning 404 to user: Instance 58800231-da1d-4abc-a4e9-76999be20567 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:10.740606 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3ab58cdf-00da-4b82-870d-0b70bc238777 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567" status: 404 len: 111 microversion: 2.1 time: 0.032789 Jul 14 11:50:10.740606 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 389/821] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:10 2022] GET /compute/v2.1/servers/58800231-da1d-4abc-a4e9-76999be20567 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:10.746088 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-bfce436a-28ad-4889-b90f-af55534f0ec5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:10.746659 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-bfce436a-28ad-4889-b90f-af55534f0ec5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:10.752938 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bfce436a-28ad-4889-b90f-af55534f0ec5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:10.754606 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bfce436a-28ad-4889-b90f-af55534f0ec5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:10.754606 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bfce436a-28ad-4889-b90f-af55534f0ec5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:10.754860 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bfce436a-28ad-4889-b90f-af55534f0ec5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:10.784836 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-bfce436a-28ad-4889-b90f-af55534f0ec5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Going to try to terminate instance {{(pid=124947) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:50:11.068865 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-bfce436a-28ad-4889-b90f-af55534f0ec5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "DELETE /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 204 len: 0 microversion: 2.1 time: 0.325826 Jul 14 11:50:11.073660 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 433/822] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:50:10 2022] DELETE /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:50:11.082311 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-339b7899-a676-47bf-a80d-ce3166e8e908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:11.083026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-339b7899-a676-47bf-a80d-ce3166e8e908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:11.089752 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-339b7899-a676-47bf-a80d-ce3166e8e908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:11.090411 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-339b7899-a676-47bf-a80d-ce3166e8e908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:11.091452 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-339b7899-a676-47bf-a80d-ce3166e8e908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:11.092453 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-339b7899-a676-47bf-a80d-ce3166e8e908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:11.247056 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-339b7899-a676-47bf-a80d-ce3166e8e908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:11.255185 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-339b7899-a676-47bf-a80d-ce3166e8e908 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.181559 Jul 14 11:50:11.255741 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 390/823] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:11 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:11.632898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-cee362d5-1361-4a1d-beb2-029ee9d583c9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:11.633617 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-cee362d5-1361-4a1d-beb2-029ee9d583c9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:11.640186 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cee362d5-1361-4a1d-beb2-029ee9d583c9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:11.640627 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cee362d5-1361-4a1d-beb2-029ee9d583c9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:11.641420 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cee362d5-1361-4a1d-beb2-029ee9d583c9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:11.641854 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cee362d5-1361-4a1d-beb2-029ee9d583c9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:11.782929 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-cee362d5-1361-4a1d-beb2-029ee9d583c9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:11.791633 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-cee362d5-1361-4a1d-beb2-029ee9d583c9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:11.793181 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-cee362d5-1361-4a1d-beb2-029ee9d583c9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:11.794365 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-cee362d5-1361-4a1d-beb2-029ee9d583c9 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.165953 Jul 14 11:50:11.794929 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 434/824] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:11 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:12.273253 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-2a640079-e344-42c0-9378-482056785ae5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:12.273875 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-2a640079-e344-42c0-9378-482056785ae5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:12.281205 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2a640079-e344-42c0-9378-482056785ae5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:12.281902 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2a640079-e344-42c0-9378-482056785ae5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:12.282934 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2a640079-e344-42c0-9378-482056785ae5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:12.283537 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-2a640079-e344-42c0-9378-482056785ae5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:12.433757 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-2a640079-e344-42c0-9378-482056785ae5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:12.442075 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-2a640079-e344-42c0-9378-482056785ae5 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.173055 Jul 14 11:50:12.442652 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 391/825] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:12 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:12.812014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ae0c781c-50d1-40ed-8f76-09351194aa9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:12.812626 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ae0c781c-50d1-40ed-8f76-09351194aa9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:12.819449 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ae0c781c-50d1-40ed-8f76-09351194aa9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:12.819886 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ae0c781c-50d1-40ed-8f76-09351194aa9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:12.820668 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ae0c781c-50d1-40ed-8f76-09351194aa9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:12.821105 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ae0c781c-50d1-40ed-8f76-09351194aa9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:12.963105 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ae0c781c-50d1-40ed-8f76-09351194aa9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:12.972184 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ae0c781c-50d1-40ed-8f76-09351194aa9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:12.974166 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ae0c781c-50d1-40ed-8f76-09351194aa9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:12.975497 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ae0c781c-50d1-40ed-8f76-09351194aa9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.167326 Jul 14 11:50:12.976243 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 435/826] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:12 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:13.459011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-fc723e03-2d0a-4e83-a6bb-8de519b6365d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:13.459581 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-fc723e03-2d0a-4e83-a6bb-8de519b6365d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:13.466476 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fc723e03-2d0a-4e83-a6bb-8de519b6365d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:13.467032 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fc723e03-2d0a-4e83-a6bb-8de519b6365d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:13.468765 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fc723e03-2d0a-4e83-a6bb-8de519b6365d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:13.469237 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fc723e03-2d0a-4e83-a6bb-8de519b6365d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:13.610199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-fc723e03-2d0a-4e83-a6bb-8de519b6365d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:13.618674 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-fc723e03-2d0a-4e83-a6bb-8de519b6365d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.163642 Jul 14 11:50:13.619430 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 392/827] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:13 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:13.994402 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1aced1c0-c444-447d-9562-ccd0da36ca00 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:13.995125 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1aced1c0-c444-447d-9562-ccd0da36ca00 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:14.002098 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1aced1c0-c444-447d-9562-ccd0da36ca00 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:14.002537 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1aced1c0-c444-447d-9562-ccd0da36ca00 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:14.003311 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1aced1c0-c444-447d-9562-ccd0da36ca00 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:14.003738 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1aced1c0-c444-447d-9562-ccd0da36ca00 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:14.143436 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1aced1c0-c444-447d-9562-ccd0da36ca00 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:14.152181 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1aced1c0-c444-447d-9562-ccd0da36ca00 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:14.153746 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1aced1c0-c444-447d-9562-ccd0da36ca00 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:14.154918 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1aced1c0-c444-447d-9562-ccd0da36ca00 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.164453 Jul 14 11:50:14.156153 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 436/828] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:13 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:14.635555 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-81b0aa49-180b-45a8-9d45-2f1dae654289 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:14.636195 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-81b0aa49-180b-45a8-9d45-2f1dae654289 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:14.642929 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-81b0aa49-180b-45a8-9d45-2f1dae654289 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:14.643378 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-81b0aa49-180b-45a8-9d45-2f1dae654289 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:14.644150 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-81b0aa49-180b-45a8-9d45-2f1dae654289 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:14.644585 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-81b0aa49-180b-45a8-9d45-2f1dae654289 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:14.787721 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-81b0aa49-180b-45a8-9d45-2f1dae654289 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:14.795114 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-81b0aa49-180b-45a8-9d45-2f1dae654289 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.163418 Jul 14 11:50:14.796224 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 393/829] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:14 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:15.174242 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-23f32651-9a65-4cf7-bf04-2be1afe7ac48 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:15.174861 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-23f32651-9a65-4cf7-bf04-2be1afe7ac48 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:15.182015 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-23f32651-9a65-4cf7-bf04-2be1afe7ac48 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:15.182475 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-23f32651-9a65-4cf7-bf04-2be1afe7ac48 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:15.185119 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-23f32651-9a65-4cf7-bf04-2be1afe7ac48 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:15.185119 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-23f32651-9a65-4cf7-bf04-2be1afe7ac48 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:15.332749 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-23f32651-9a65-4cf7-bf04-2be1afe7ac48 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:15.342025 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-23f32651-9a65-4cf7-bf04-2be1afe7ac48 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:15.344124 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-23f32651-9a65-4cf7-bf04-2be1afe7ac48 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:15.350892 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-23f32651-9a65-4cf7-bf04-2be1afe7ac48 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.181267 Jul 14 11:50:15.354830 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 437/830] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:15 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:15.816537 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-92634a6a-49ad-47a6-8b59-89b03756ef2b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:15.817916 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-92634a6a-49ad-47a6-8b59-89b03756ef2b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:15.824800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-92634a6a-49ad-47a6-8b59-89b03756ef2b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:15.825351 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-92634a6a-49ad-47a6-8b59-89b03756ef2b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:15.826070 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-92634a6a-49ad-47a6-8b59-89b03756ef2b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:15.826630 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-92634a6a-49ad-47a6-8b59-89b03756ef2b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:16.004077 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-92634a6a-49ad-47a6-8b59-89b03756ef2b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:16.011957 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-92634a6a-49ad-47a6-8b59-89b03756ef2b tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.203046 Jul 14 11:50:16.012809 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 394/831] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:15 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:16.371415 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-68eeb87c-a532-41b6-b157-b736fbab61c4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:16.372389 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-68eeb87c-a532-41b6-b157-b736fbab61c4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:16.391280 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-68eeb87c-a532-41b6-b157-b736fbab61c4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:16.391791 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-68eeb87c-a532-41b6-b157-b736fbab61c4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:16.392796 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-68eeb87c-a532-41b6-b157-b736fbab61c4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:16.393284 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-68eeb87c-a532-41b6-b157-b736fbab61c4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:16.580091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-68eeb87c-a532-41b6-b157-b736fbab61c4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:16.589640 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-68eeb87c-a532-41b6-b157-b736fbab61c4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:16.591176 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-68eeb87c-a532-41b6-b157-b736fbab61c4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:16.592367 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-68eeb87c-a532-41b6-b157-b736fbab61c4 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.225154 Jul 14 11:50:16.592977 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 438/832] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:16 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:17.029777 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-415893d5-6f76-4fb8-af50-3f041f3346ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:17.030457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-415893d5-6f76-4fb8-af50-3f041f3346ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:17.037475 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-415893d5-6f76-4fb8-af50-3f041f3346ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:17.037930 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-415893d5-6f76-4fb8-af50-3f041f3346ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:17.038712 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-415893d5-6f76-4fb8-af50-3f041f3346ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:17.039340 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-415893d5-6f76-4fb8-af50-3f041f3346ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:17.182263 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-415893d5-6f76-4fb8-af50-3f041f3346ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:17.190458 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-415893d5-6f76-4fb8-af50-3f041f3346ee tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.164676 Jul 14 11:50:17.193372 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 395/833] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:17 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:17.610705 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ca3a197d-36a4-41d3-9a55-3cc51c8a17da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:17.612515 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ca3a197d-36a4-41d3-9a55-3cc51c8a17da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:17.619319 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca3a197d-36a4-41d3-9a55-3cc51c8a17da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:17.619894 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca3a197d-36a4-41d3-9a55-3cc51c8a17da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:17.620745 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca3a197d-36a4-41d3-9a55-3cc51c8a17da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:17.621316 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca3a197d-36a4-41d3-9a55-3cc51c8a17da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:17.770815 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ca3a197d-36a4-41d3-9a55-3cc51c8a17da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:17.784170 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ca3a197d-36a4-41d3-9a55-3cc51c8a17da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:17.785905 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ca3a197d-36a4-41d3-9a55-3cc51c8a17da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:17.787114 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ca3a197d-36a4-41d3-9a55-3cc51c8a17da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.180474 Jul 14 11:50:17.787680 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 439/834] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:17 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:18.129000 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-1d7c1356-5e9f-424e-b7d7-6d1a594c419d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-963610259"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:18.129650 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-1d7c1356-5e9f-424e-b7d7-6d1a594c419d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:18.139270 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1d7c1356-5e9f-424e-b7d7-6d1a594c419d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:18.140287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1d7c1356-5e9f-424e-b7d7-6d1a594c419d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:18.141066 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1d7c1356-5e9f-424e-b7d7-6d1a594c419d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:18.141551 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1d7c1356-5e9f-424e-b7d7-6d1a594c419d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:18.208471 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-4f44a27a-4108-4eaa-91ff-c3da3f792c45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:18.209091 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-4f44a27a-4108-4eaa-91ff-c3da3f792c45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:18.218409 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4f44a27a-4108-4eaa-91ff-c3da3f792c45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:18.218858 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4f44a27a-4108-4eaa-91ff-c3da3f792c45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:18.219707 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4f44a27a-4108-4eaa-91ff-c3da3f792c45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:18.220146 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4f44a27a-4108-4eaa-91ff-c3da3f792c45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:18.296636 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.network.security_group_api [None req-1d7c1356-5e9f-424e-b7d7-6d1a594c419d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Removing security group bdcddd37-a8d7-4d2f-9ee3-1d39d05d16e1 from port f79bdd51-95b5-4720-a060-677fe13019be Jul 14 11:50:18.378365 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-4f44a27a-4108-4eaa-91ff-c3da3f792c45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:18.380568 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-4f44a27a-4108-4eaa-91ff-c3da3f792c45 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.175718 Jul 14 11:50:18.381093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 440/835] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:18 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:18.745092 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-1d7c1356-5e9f-424e-b7d7-6d1a594c419d tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "POST /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/action" status: 202 len: 0 microversion: 2.1 time: 0.620294 Jul 14 11:50:18.749959 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 396/836] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 11:50:18 2022] POST /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:50:18.769873 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-f2498c57-5a39-40b2-89de-d741886b151d req-5972a3ca-7b06-4b10-a2f6-8dbf588cc413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88440aae-c9af-4f69-bdae-38f9d81c06a7", "tag": "f79bdd51-95b5-4720-a060-677fe13019be"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:18.789997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-f2498c57-5a39-40b2-89de-d741886b151d req-5972a3ca-7b06-4b10-a2f6-8dbf588cc413 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:18.790451 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-f2498c57-5a39-40b2-89de-d741886b151d req-5972a3ca-7b06-4b10-a2f6-8dbf588cc413 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:18.808914 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a8187db1-ec5b-4198-8f0f-a67e80f26291 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:18.810901 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a8187db1-ec5b-4198-8f0f-a67e80f26291 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:18.821250 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a8187db1-ec5b-4198-8f0f-a67e80f26291 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:18.822159 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a8187db1-ec5b-4198-8f0f-a67e80f26291 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:18.823144 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a8187db1-ec5b-4198-8f0f-a67e80f26291 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:18.829909 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a8187db1-ec5b-4198-8f0f-a67e80f26291 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:18.833257 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-f2498c57-5a39-40b2-89de-d741886b151d req-5972a3ca-7b06-4b10-a2f6-8dbf588cc413 service nova] Creating event network-changed:f79bdd51-95b5-4720-a060-677fe13019be for instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 on hv-cinder-84980 Jul 14 11:50:18.840264 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-f2498c57-5a39-40b2-89de-d741886b151d req-5972a3ca-7b06-4b10-a2f6-8dbf588cc413 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075056 Jul 14 11:50:18.840864 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 441/837] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:19.050837 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a8187db1-ec5b-4198-8f0f-a67e80f26291 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:19.053327 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:19.060111 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a8187db1-ec5b-4198-8f0f-a67e80f26291 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:19.061667 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a8187db1-ec5b-4198-8f0f-a67e80f26291 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:19.062875 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a8187db1-ec5b-4198-8f0f-a67e80f26291 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.258922 Jul 14 11:50:19.063472 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 397/838] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:18 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:19.399982 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-90ff564d-7431-4da9-bb62-2a39c1050b79 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:19.400765 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-90ff564d-7431-4da9-bb62-2a39c1050b79 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:19.407568 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90ff564d-7431-4da9-bb62-2a39c1050b79 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:19.408023 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90ff564d-7431-4da9-bb62-2a39c1050b79 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:19.408810 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90ff564d-7431-4da9-bb62-2a39c1050b79 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:19.409281 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90ff564d-7431-4da9-bb62-2a39c1050b79 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:19.549878 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-90ff564d-7431-4da9-bb62-2a39c1050b79 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:19.558024 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-90ff564d-7431-4da9-bb62-2a39c1050b79 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.164060 Jul 14 11:50:19.558612 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 442/839] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:19 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:20.068352 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-0532f919-767c-41c0-9c96-efca2b11aa2a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:20.068890 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-0532f919-767c-41c0-9c96-efca2b11aa2a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:20.077429 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0532f919-767c-41c0-9c96-efca2b11aa2a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:20.078169 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0532f919-767c-41c0-9c96-efca2b11aa2a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:20.078943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0532f919-767c-41c0-9c96-efca2b11aa2a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:20.079378 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0532f919-767c-41c0-9c96-efca2b11aa2a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:20.080137 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ca980ea1-2f66-4ac4-87f6-340f5bdb1b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:20.080753 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ca980ea1-2f66-4ac4-87f6-340f5bdb1b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:20.087045 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca980ea1-2f66-4ac4-87f6-340f5bdb1b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:20.087497 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca980ea1-2f66-4ac4-87f6-340f5bdb1b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:20.088261 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca980ea1-2f66-4ac4-87f6-340f5bdb1b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:20.088688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ca980ea1-2f66-4ac4-87f6-340f5bdb1b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:20.169647 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-0532f919-767c-41c0-9c96-efca2b11aa2a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lazy-loading 'services' on Instance uuid 88440aae-c9af-4f69-bdae-38f9d81c06a7 {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:50:20.233863 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ca980ea1-2f66-4ac4-87f6-340f5bdb1b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:20.242678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ca980ea1-2f66-4ac4-87f6-340f5bdb1b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:20.244297 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ca980ea1-2f66-4ac4-87f6-340f5bdb1b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:20.245565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ca980ea1-2f66-4ac4-87f6-340f5bdb1b7f tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.169394 Jul 14 11:50:20.246195 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 443/840] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:20 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:50:20.381855 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-0532f919-767c-41c0-9c96-efca2b11aa2a tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "DELETE /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments/40c4da5d-6fda-434f-bcc3-c00257402c06" status: 202 len: 0 microversion: 2.1 time: 0.317534 Jul 14 11:50:20.382521 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 398/841] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 11:50:20 2022] DELETE /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments/40c4da5d-6fda-434f-bcc3-c00257402c06 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:50:20.391265 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-69c7b617-f6f7-43d0-b982-421b4f633965 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:20.392330 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-69c7b617-f6f7-43d0-b982-421b4f633965 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:20.399072 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-69c7b617-f6f7-43d0-b982-421b4f633965 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:20.399596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-69c7b617-f6f7-43d0-b982-421b4f633965 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:20.402036 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-69c7b617-f6f7-43d0-b982-421b4f633965 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:20.402036 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-69c7b617-f6f7-43d0-b982-421b4f633965 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:20.426267 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:20.430869 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-69c7b617-f6f7-43d0-b982-421b4f633965 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043697 Jul 14 11:50:20.431646 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 444/842] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:50:20 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:20.638325 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-95873dce-fbaa-4610-a499-2e4347967e21 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:20.639063 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-95873dce-fbaa-4610-a499-2e4347967e21 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:20.646332 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-95873dce-fbaa-4610-a499-2e4347967e21 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:20.646332 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-95873dce-fbaa-4610-a499-2e4347967e21 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:20.647394 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-95873dce-fbaa-4610-a499-2e4347967e21 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:20.647840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-95873dce-fbaa-4610-a499-2e4347967e21 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:20.787752 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-95873dce-fbaa-4610-a499-2e4347967e21 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:20.795484 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-95873dce-fbaa-4610-a499-2e4347967e21 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.223854 Jul 14 11:50:20.796053 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 399/843] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:20 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:20.854740 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-7c88b097-7d59-46f8-80a0-6f48ccd327d0 req-c8ecc7be-35fa-4375-ad2a-c8cdeb56917c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88440aae-c9af-4f69-bdae-38f9d81c06a7", "tag": "f79bdd51-95b5-4720-a060-677fe13019be"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:20.863847 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-7c88b097-7d59-46f8-80a0-6f48ccd327d0 req-c8ecc7be-35fa-4375-ad2a-c8cdeb56917c service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:20.864222 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-7c88b097-7d59-46f8-80a0-6f48ccd327d0 req-c8ecc7be-35fa-4375-ad2a-c8cdeb56917c service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:20.876772 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-7c88b097-7d59-46f8-80a0-6f48ccd327d0 req-c8ecc7be-35fa-4375-ad2a-c8cdeb56917c service nova] Creating event network-changed:f79bdd51-95b5-4720-a060-677fe13019be for instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 on hv-cinder-84980 Jul 14 11:50:20.881720 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-7c88b097-7d59-46f8-80a0-6f48ccd327d0 req-c8ecc7be-35fa-4375-ad2a-c8cdeb56917c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030515 Jul 14 11:50:20.882331 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 445/844] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:21.263393 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-900a7318-f6b7-4e48-80f6-c812b62fae12 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:21.264165 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-900a7318-f6b7-4e48-80f6-c812b62fae12 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:21.271159 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-900a7318-f6b7-4e48-80f6-c812b62fae12 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:21.271602 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-900a7318-f6b7-4e48-80f6-c812b62fae12 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:21.272617 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-900a7318-f6b7-4e48-80f6-c812b62fae12 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:21.273053 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-900a7318-f6b7-4e48-80f6-c812b62fae12 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:21.405505 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-900a7318-f6b7-4e48-80f6-c812b62fae12 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:21.414120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-900a7318-f6b7-4e48-80f6-c812b62fae12 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:21.415655 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-900a7318-f6b7-4e48-80f6-c812b62fae12 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:21.416809 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-900a7318-f6b7-4e48-80f6-c812b62fae12 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.157326 Jul 14 11:50:21.417398 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 400/845] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:21 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:50:21.444231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1a89fe6a-34f4-4439-a533-34657edf3c41 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:21.445300 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1a89fe6a-34f4-4439-a533-34657edf3c41 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:21.452076 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1a89fe6a-34f4-4439-a533-34657edf3c41 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:21.452516 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1a89fe6a-34f4-4439-a533-34657edf3c41 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:21.453302 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1a89fe6a-34f4-4439-a533-34657edf3c41 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:21.453730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1a89fe6a-34f4-4439-a533-34657edf3c41 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:21.485080 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1a89fe6a-34f4-4439-a533-34657edf3c41 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045490 Jul 14 11:50:21.485713 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 446/846] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:50:21 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:21.811922 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-17996ef2-5f91-4886-b6f3-2928390ef426 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:21.812540 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-17996ef2-5f91-4886-b6f3-2928390ef426 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:21.819048 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-17996ef2-5f91-4886-b6f3-2928390ef426 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:21.819502 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-17996ef2-5f91-4886-b6f3-2928390ef426 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:21.820276 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-17996ef2-5f91-4886-b6f3-2928390ef426 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:21.820713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-17996ef2-5f91-4886-b6f3-2928390ef426 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:21.955974 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-17996ef2-5f91-4886-b6f3-2928390ef426 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:21.963540 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-17996ef2-5f91-4886-b6f3-2928390ef426 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.155463 Jul 14 11:50:21.964111 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 401/847] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:21 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:22.434800 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-699fdd6e-dff3-4a66-a173-4cb6969626dc tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:22.435445 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-699fdd6e-dff3-4a66-a173-4cb6969626dc tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:22.442155 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-699fdd6e-dff3-4a66-a173-4cb6969626dc tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:22.442604 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-699fdd6e-dff3-4a66-a173-4cb6969626dc tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:22.443371 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-699fdd6e-dff3-4a66-a173-4cb6969626dc tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:22.443816 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-699fdd6e-dff3-4a66-a173-4cb6969626dc tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:22.496090 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4c84333b-025a-4355-8b82-3d783d76dc3e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:22.497094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-4c84333b-025a-4355-8b82-3d783d76dc3e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:22.503719 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4c84333b-025a-4355-8b82-3d783d76dc3e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:22.504164 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4c84333b-025a-4355-8b82-3d783d76dc3e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:22.504934 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4c84333b-025a-4355-8b82-3d783d76dc3e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:22.505397 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4c84333b-025a-4355-8b82-3d783d76dc3e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:22.534722 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-4c84333b-025a-4355-8b82-3d783d76dc3e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042511 Jul 14 11:50:22.535281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 402/848] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:50:22 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:50:22.573537 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-699fdd6e-dff3-4a66-a173-4cb6969626dc tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:22.581577 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-699fdd6e-dff3-4a66-a173-4cb6969626dc tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:22.583139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-699fdd6e-dff3-4a66-a173-4cb6969626dc tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:22.584293 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-699fdd6e-dff3-4a66-a173-4cb6969626dc tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.153416 Jul 14 11:50:22.584852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 447/849] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:22 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:22.981115 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-02727336-38cd-48ab-983f-d728bb6064b9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:22.981674 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-02727336-38cd-48ab-983f-d728bb6064b9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:22.987762 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-02727336-38cd-48ab-983f-d728bb6064b9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:22.988211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-02727336-38cd-48ab-983f-d728bb6064b9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:22.988976 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-02727336-38cd-48ab-983f-d728bb6064b9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:22.989470 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-02727336-38cd-48ab-983f-d728bb6064b9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:23.152966 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-02727336-38cd-48ab-983f-d728bb6064b9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:23.160487 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-02727336-38cd-48ab-983f-d728bb6064b9 tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.184542 Jul 14 11:50:23.161041 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 403/850] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:22 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:23.456750 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-e8b249f2-f599-4318-8341-01ff036d0dea req-c9456d0d-6ffc-4052-a103-c2ea8fe7acec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08c817f-cc75-4c71-8645-51a7a1938404", "name": "network-vif-plugged", "status": "completed", "tag": "5c8aa46b-5efe-4ab3-b31e-03775de21303"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:23.466659 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-e8b249f2-f599-4318-8341-01ff036d0dea req-c9456d0d-6ffc-4052-a103-c2ea8fe7acec service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:23.467624 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-e8b249f2-f599-4318-8341-01ff036d0dea req-c9456d0d-6ffc-4052-a103-c2ea8fe7acec service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:23.481965 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-e8b249f2-f599-4318-8341-01ff036d0dea req-c9456d0d-6ffc-4052-a103-c2ea8fe7acec service nova] Creating event network-vif-plugged:5c8aa46b-5efe-4ab3-b31e-03775de21303 for instance e08c817f-cc75-4c71-8645-51a7a1938404 on hv-cinder-84980 Jul 14 11:50:23.489697 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-e8b249f2-f599-4318-8341-01ff036d0dea req-c9456d0d-6ffc-4052-a103-c2ea8fe7acec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036382 Jul 14 11:50:23.490461 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 448/851] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:23.547389 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b19bc65b-d8d4-4cee-bce5-0710eb0b229f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:23.548977 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b19bc65b-d8d4-4cee-bce5-0710eb0b229f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:23.562174 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b19bc65b-d8d4-4cee-bce5-0710eb0b229f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:23.562174 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b19bc65b-d8d4-4cee-bce5-0710eb0b229f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:23.562174 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b19bc65b-d8d4-4cee-bce5-0710eb0b229f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:23.562498 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b19bc65b-d8d4-4cee-bce5-0710eb0b229f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:23.601178 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b19bc65b-d8d4-4cee-bce5-0710eb0b229f tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058192 Jul 14 11:50:23.601773 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 404/852] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:50:23 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:23.602617 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ec50834b-b262-46ac-b644-23e52dcdf66a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:23.603321 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ec50834b-b262-46ac-b644-23e52dcdf66a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:23.611195 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ec50834b-b262-46ac-b644-23e52dcdf66a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:23.611637 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ec50834b-b262-46ac-b644-23e52dcdf66a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:23.612635 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ec50834b-b262-46ac-b644-23e52dcdf66a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:23.613068 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ec50834b-b262-46ac-b644-23e52dcdf66a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:23.764541 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ec50834b-b262-46ac-b644-23e52dcdf66a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:23.773995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ec50834b-b262-46ac-b644-23e52dcdf66a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:23.775523 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ec50834b-b262-46ac-b644-23e52dcdf66a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:23.776762 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ec50834b-b262-46ac-b644-23e52dcdf66a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.178299 Jul 14 11:50:23.787783 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 449/853] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:23 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:50:23.980778 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-fbf17331-a26a-42e2-ae44-3a642572847a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:23.981699 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-fbf17331-a26a-42e2-ae44-3a642572847a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:23.988708 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fbf17331-a26a-42e2-ae44-3a642572847a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:23.989601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fbf17331-a26a-42e2-ae44-3a642572847a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:23.990520 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fbf17331-a26a-42e2-ae44-3a642572847a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:23.991780 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fbf17331-a26a-42e2-ae44-3a642572847a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:24.097209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-fbf17331-a26a-42e2-ae44-3a642572847a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lazy-loading 'services' on Instance uuid 046cf283-3c75-404b-b0a5-47ff4e2b9b38 {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:50:24.177283 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1a49d0ef-1e26-47b0-b5ba-e642bae7484d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:24.177912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1a49d0ef-1e26-47b0-b5ba-e642bae7484d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:24.183946 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1a49d0ef-1e26-47b0-b5ba-e642bae7484d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:24.184396 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1a49d0ef-1e26-47b0-b5ba-e642bae7484d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:24.185219 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1a49d0ef-1e26-47b0-b5ba-e642bae7484d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:24.185694 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1a49d0ef-1e26-47b0-b5ba-e642bae7484d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:24.325411 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1a49d0ef-1e26-47b0-b5ba-e642bae7484d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:24.333722 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1a49d0ef-1e26-47b0-b5ba-e642bae7484d tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1520 microversion: 2.1 time: 0.161113 Jul 14 11:50:24.334287 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 450/854] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:24 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:50:24.338759 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-934aa02f-2be4-4dfd-878d-85e4c36f36d7 req-15719518-509d-48ec-834b-3bcbf5e6bd23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336dc998-9572-45da-bf2b-b3490712426c", "name": "network-vif-deleted", "tag": "f84daf6d-a5b5-4dcc-95ba-a981a1687434"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:24.347262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-934aa02f-2be4-4dfd-878d-85e4c36f36d7 req-15719518-509d-48ec-834b-3bcbf5e6bd23 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:24.347757 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-934aa02f-2be4-4dfd-878d-85e4c36f36d7 req-15719518-509d-48ec-834b-3bcbf5e6bd23 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:24.358408 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-fbf17331-a26a-42e2-ae44-3a642572847a tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "DELETE /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/os-volume_attachments/b4c97e85-d5b5-4c11-8b01-a17427e6b261" status: 202 len: 0 microversion: 2.1 time: 0.382272 Jul 14 11:50:24.359038 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 405/855] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 11:50:23 2022] DELETE /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/os-volume_attachments/b4c97e85-d5b5-4c11-8b01-a17427e6b261 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:50:24.360775 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-934aa02f-2be4-4dfd-878d-85e4c36f36d7 req-15719518-509d-48ec-834b-3bcbf5e6bd23 service nova] Creating event network-vif-deleted:f84daf6d-a5b5-4dcc-95ba-a981a1687434 for instance 336dc998-9572-45da-bf2b-b3490712426c on hv-cinder-84980 Jul 14 11:50:24.367442 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-934aa02f-2be4-4dfd-878d-85e4c36f36d7 req-15719518-509d-48ec-834b-3bcbf5e6bd23 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031651 Jul 14 11:50:24.368116 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 451/856] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:24.381963 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-0968b917-32a7-4248-bcb4-98a0821b2d40 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:24.382999 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-0968b917-32a7-4248-bcb4-98a0821b2d40 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:24.391331 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0968b917-32a7-4248-bcb4-98a0821b2d40 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:24.396244 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0968b917-32a7-4248-bcb4-98a0821b2d40 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:24.396244 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0968b917-32a7-4248-bcb4-98a0821b2d40 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:24.396244 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0968b917-32a7-4248-bcb4-98a0821b2d40 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:24.579966 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-0968b917-32a7-4248-bcb4-98a0821b2d40 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213718 Jul 14 11:50:24.580631 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 406/857] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:50:24 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:50:24.613289 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-09ab070e-e0db-4c63-a9e0-fee6b3efbf03 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:24.614333 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-09ab070e-e0db-4c63-a9e0-fee6b3efbf03 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:24.621750 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-09ab070e-e0db-4c63-a9e0-fee6b3efbf03 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:24.622203 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-09ab070e-e0db-4c63-a9e0-fee6b3efbf03 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:24.622979 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-09ab070e-e0db-4c63-a9e0-fee6b3efbf03 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:24.623406 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-09ab070e-e0db-4c63-a9e0-fee6b3efbf03 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:24.655090 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-09ab070e-e0db-4c63-a9e0-fee6b3efbf03 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046219 Jul 14 11:50:24.655664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 452/858] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:50:24 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:24.796967 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d5aa811e-1e7d-451f-a240-d0e5b4af99da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:24.797674 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d5aa811e-1e7d-451f-a240-d0e5b4af99da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:24.804662 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5aa811e-1e7d-451f-a240-d0e5b4af99da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:24.805113 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5aa811e-1e7d-451f-a240-d0e5b4af99da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:24.805931 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5aa811e-1e7d-451f-a240-d0e5b4af99da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:24.806370 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5aa811e-1e7d-451f-a240-d0e5b4af99da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:24.958214 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d5aa811e-1e7d-451f-a240-d0e5b4af99da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:24.966207 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d5aa811e-1e7d-451f-a240-d0e5b4af99da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:24.968347 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d5aa811e-1e7d-451f-a240-d0e5b4af99da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:24.968956 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d5aa811e-1e7d-451f-a240-d0e5b4af99da tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.176836 Jul 14 11:50:24.969637 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 407/859] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:24 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:25.350888 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-efa601d2-31dd-4c63-9763-f535054ee8ec tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:25.351503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-efa601d2-31dd-4c63-9763-f535054ee8ec tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:25.357622 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-efa601d2-31dd-4c63-9763-f535054ee8ec tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:25.358066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-efa601d2-31dd-4c63-9763-f535054ee8ec tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:25.358826 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-efa601d2-31dd-4c63-9763-f535054ee8ec tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:25.359258 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-efa601d2-31dd-4c63-9763-f535054ee8ec tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:25.390279 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-efa601d2-31dd-4c63-9763-f535054ee8ec tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:25.390720 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-efa601d2-31dd-4c63-9763-f535054ee8ec tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:25.391173 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-efa601d2-31dd-4c63-9763-f535054ee8ec tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lazy-loading 'fault' on Instance uuid 336dc998-9572-45da-bf2b-b3490712426c {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:50:25.592042 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-1ada97ab-d25b-477b-9d02-cfe824cd2b9c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:25.593775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-1ada97ab-d25b-477b-9d02-cfe824cd2b9c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:25.600706 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1ada97ab-d25b-477b-9d02-cfe824cd2b9c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:25.601231 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1ada97ab-d25b-477b-9d02-cfe824cd2b9c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:25.601962 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1ada97ab-d25b-477b-9d02-cfe824cd2b9c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:25.602394 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1ada97ab-d25b-477b-9d02-cfe824cd2b9c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:25.635072 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-1ada97ab-d25b-477b-9d02-cfe824cd2b9c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047049 Jul 14 11:50:25.635636 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 408/860] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:50:25 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:25.676463 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-525eb8f7-97c8-42eb-889f-0480fcfb7c98 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:25.677446 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-525eb8f7-97c8-42eb-889f-0480fcfb7c98 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:25.683884 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-efa601d2-31dd-4c63-9763-f535054ee8ec tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf3f705e04640a2a5d9bedb71c6ccb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '951609a482e34e93908057a68c5dc706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:25.687550 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-525eb8f7-97c8-42eb-889f-0480fcfb7c98 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:25.688166 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-525eb8f7-97c8-42eb-889f-0480fcfb7c98 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:25.689509 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-525eb8f7-97c8-42eb-889f-0480fcfb7c98 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:25.689941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-525eb8f7-97c8-42eb-889f-0480fcfb7c98 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:25.695001 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-efa601d2-31dd-4c63-9763-f535054ee8ec tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 200 len: 1310 microversion: 2.1 time: 0.347728 Jul 14 11:50:25.695780 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 453/861] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:25 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 1310 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:25.726940 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-525eb8f7-97c8-42eb-889f-0480fcfb7c98 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059664 Jul 14 11:50:25.727591 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 409/862] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:50:25 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:50:25.988414 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d5a27870-f8be-4013-93f4-f80bcd4cb7be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:25.989027 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d5a27870-f8be-4013-93f4-f80bcd4cb7be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:25.992961 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-340d6afd-9e0f-4569-8444-e6d858d740ad tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:25.993515 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-340d6afd-9e0f-4569-8444-e6d858d740ad tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:25.995325 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5a27870-f8be-4013-93f4-f80bcd4cb7be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:25.995776 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5a27870-f8be-4013-93f4-f80bcd4cb7be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:25.996550 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5a27870-f8be-4013-93f4-f80bcd4cb7be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:25.996989 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5a27870-f8be-4013-93f4-f80bcd4cb7be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:25.999574 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-340d6afd-9e0f-4569-8444-e6d858d740ad tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:26.000027 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-340d6afd-9e0f-4569-8444-e6d858d740ad tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:26.000835 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-340d6afd-9e0f-4569-8444-e6d858d740ad tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:26.001830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-340d6afd-9e0f-4569-8444-e6d858d740ad tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:26.031576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-340d6afd-9e0f-4569-8444-e6d858d740ad tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments/1ebd4418-e5e3-4dfb-b54c-537e3bca0f54" status: 200 len: 194 microversion: 2.1 time: 0.042808 Jul 14 11:50:26.032192 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 410/863] 10.222.0.40 () {58 vars in 1412 bytes} [Thu Jul 14 11:50:25 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments/1ebd4418-e5e3-4dfb-b54c-537e3bca0f54 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:50:26.041935 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-33d15587-a561-4ab9-be6e-ca7d4deb8d4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:26.042437 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-33d15587-a561-4ab9-be6e-ca7d4deb8d4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:26.049617 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-33d15587-a561-4ab9-be6e-ca7d4deb8d4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:26.050068 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-33d15587-a561-4ab9-be6e-ca7d4deb8d4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:26.050848 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-33d15587-a561-4ab9-be6e-ca7d4deb8d4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:26.051284 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-33d15587-a561-4ab9-be6e-ca7d4deb8d4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:26.133728 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-33d15587-a561-4ab9-be6e-ca7d4deb8d4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lazy-loading 'services' on Instance uuid 4a9a7ce6-aede-493e-8e91-b35f4c51d954 {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:50:26.137430 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d5a27870-f8be-4013-93f4-f80bcd4cb7be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:26.146135 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d5a27870-f8be-4013-93f4-f80bcd4cb7be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:26.147926 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d5a27870-f8be-4013-93f4-f80bcd4cb7be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:26.149084 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d5a27870-f8be-4013-93f4-f80bcd4cb7be tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.165093 Jul 14 11:50:26.149672 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 454/864] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:25 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:26.369672 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-33d15587-a561-4ab9-be6e-ca7d4deb8d4d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments/1ebd4418-e5e3-4dfb-b54c-537e3bca0f54" status: 202 len: 0 microversion: 2.1 time: 0.331208 Jul 14 11:50:26.371598 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 411/865] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 11:50:26 2022] DELETE /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments/1ebd4418-e5e3-4dfb-b54c-537e3bca0f54 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:50:26.646901 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7011169b-3574-485d-87d1-65f273689652 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:26.648141 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7011169b-3574-485d-87d1-65f273689652 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:26.654570 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7011169b-3574-485d-87d1-65f273689652 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:26.656076 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7011169b-3574-485d-87d1-65f273689652 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:26.656076 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7011169b-3574-485d-87d1-65f273689652 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:26.656267 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7011169b-3574-485d-87d1-65f273689652 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:26.685130 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7011169b-3574-485d-87d1-65f273689652 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041577 Jul 14 11:50:26.685130 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 455/866] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:50:26 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:26.712797 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-163cb382-6e05-4150-8cae-9352d7e73faf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:26.713538 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-163cb382-6e05-4150-8cae-9352d7e73faf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] [instance: 336dc998-9572-45da-bf2b-b3490712426c] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:26.719893 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-163cb382-6e05-4150-8cae-9352d7e73faf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:26.720356 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-163cb382-6e05-4150-8cae-9352d7e73faf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:26.721734 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-163cb382-6e05-4150-8cae-9352d7e73faf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:26.721734 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-163cb382-6e05-4150-8cae-9352d7e73faf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:26.735941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-163cb382-6e05-4150-8cae-9352d7e73faf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] HTTP exception thrown: Instance 336dc998-9572-45da-bf2b-b3490712426c could not be found. Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-163cb382-6e05-4150-8cae-9352d7e73faf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Request method failure captured: Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c HTTP/1.1 Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AHQD1ds0B25g5a12RFZgJ1X93Ad5kZKaW0a1WjTLos6WW0CS6889iadn7zLg9bxO6vFXCGcHydQ85EksLgMo8lXHCJEJA7JIza9eewxu56JoCts8WylfsrATjwEt9XaewZT3n2T3tUxjz2Qgf3sANPTml-AV6YyBO2MzgTVNMnGeHI Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 951609a482e34e93908057a68c5dc706 Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-954968877 Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:50:26.737648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:50:26.739069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/951609a482e34e93908057a68c5dc706"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_951609a482e34e93908057a68c5dc706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/951609a482e34e93908057a68c5dc706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/951609a482e34e93908057a68c5dc706"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:26.739069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-ServerRescueNegativeTestJSON-954968877 Jul 14 11:50:26.739069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 951609a482e34e93908057a68c5dc706 Jul 14 11:50:26.739069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-954968877 Jul 14 11:50:26.739069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-ServerRescueNegativeTestJSON-954968877-project Jul 14 11:50:26.739069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:50:26.739069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:50:26.739069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 7bf3f705e04640a2a5d9bedb71c6ccb5 Jul 14 11:50:26.739069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-ServerRescueNegativeTestJSON-954968877-project Jul 14 11:50:26.739069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:50:26.739069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 336dc998-9572-45da-bf2b-b3490712426c could not be found. Jul 14 11:50:26.739069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '336dc998-9572-45da-bf2b-b3490712426c'} Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 336dc998-9572-45da-bf2b-b3490712426c could not be found. Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:26.740064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 336dc998-9572-45da-bf2b-b3490712426c could not be found. Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 336dc998-9572-45da-bf2b-b3490712426c could not be found. Jul 14 11:50:26.741543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:26.743608 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-163cb382-6e05-4150-8cae-9352d7e73faf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] Returning 404 to user: Instance 336dc998-9572-45da-bf2b-b3490712426c could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:26.743608 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-163cb382-6e05-4150-8cae-9352d7e73faf tempest-ServerRescueNegativeTestJSON-954968877 tempest-ServerRescueNegativeTestJSON-954968877-project] 10.222.0.40 "GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c" status: 404 len: 111 microversion: 2.1 time: 0.031101 Jul 14 11:50:26.744366 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9cbf1d7a-4aa8-413b-a761-4a7654b9e027 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:26.744366 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9cbf1d7a-4aa8-413b-a761-4a7654b9e027 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:26.744929 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 412/867] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:26 2022] GET /compute/v2.1/servers/336dc998-9572-45da-bf2b-b3490712426c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:26.745184 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:26.750497 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cbf1d7a-4aa8-413b-a761-4a7654b9e027 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:26.752006 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cbf1d7a-4aa8-413b-a761-4a7654b9e027 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:26.752354 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cbf1d7a-4aa8-413b-a761-4a7654b9e027 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:26.752791 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cbf1d7a-4aa8-413b-a761-4a7654b9e027 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:26.784430 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9cbf1d7a-4aa8-413b-a761-4a7654b9e027 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049467 Jul 14 11:50:26.785357 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 456/868] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:50:26 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:50:27.167125 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3c339b28-33fb-42eb-8180-76ff5a09ce9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:27.167851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3c339b28-33fb-42eb-8180-76ff5a09ce9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:27.174674 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3c339b28-33fb-42eb-8180-76ff5a09ce9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:27.175204 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3c339b28-33fb-42eb-8180-76ff5a09ce9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:27.176052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3c339b28-33fb-42eb-8180-76ff5a09ce9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:27.176583 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3c339b28-33fb-42eb-8180-76ff5a09ce9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:27.180800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:27.423641 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-3c339b28-33fb-42eb-8180-76ff5a09ce9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:27.431650 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-3c339b28-33fb-42eb-8180-76ff5a09ce9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:27.433496 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-3c339b28-33fb-42eb-8180-76ff5a09ce9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:27.434662 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3c339b28-33fb-42eb-8180-76ff5a09ce9b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1731 microversion: 2.20 time: 0.271648 Jul 14 11:50:27.435206 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 413/869] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:27 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1731 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:50:27.696504 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ef6604e2-b9b8-464f-82b6-6ca479058e21 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:27.698166 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ef6604e2-b9b8-464f-82b6-6ca479058e21 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:27.707026 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ef6604e2-b9b8-464f-82b6-6ca479058e21 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:27.707481 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ef6604e2-b9b8-464f-82b6-6ca479058e21 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:27.708341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ef6604e2-b9b8-464f-82b6-6ca479058e21 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:27.708795 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ef6604e2-b9b8-464f-82b6-6ca479058e21 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:27.739588 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ef6604e2-b9b8-464f-82b6-6ca479058e21 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047510 Jul 14 11:50:27.740262 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 457/870] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:50:27 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:50:27.799436 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3db2d2aa-ceea-4ac8-ac34-3098d38b5e11 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:27.799436 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3db2d2aa-ceea-4ac8-ac34-3098d38b5e11 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:27.804148 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6bfa643c-7aa5-4e32-8c6f-3fe02960c13d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:27.804651 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6bfa643c-7aa5-4e32-8c6f-3fe02960c13d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:27.808163 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3db2d2aa-ceea-4ac8-ac34-3098d38b5e11 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:27.808163 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3db2d2aa-ceea-4ac8-ac34-3098d38b5e11 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:27.809119 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3db2d2aa-ceea-4ac8-ac34-3098d38b5e11 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:27.809621 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3db2d2aa-ceea-4ac8-ac34-3098d38b5e11 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:27.811684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6bfa643c-7aa5-4e32-8c6f-3fe02960c13d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:27.812136 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6bfa643c-7aa5-4e32-8c6f-3fe02960c13d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:27.812903 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6bfa643c-7aa5-4e32-8c6f-3fe02960c13d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:27.814089 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6bfa643c-7aa5-4e32-8c6f-3fe02960c13d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:27.840310 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3db2d2aa-ceea-4ac8-ac34-3098d38b5e11 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047753 Jul 14 11:50:27.840886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 414/871] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:50:27 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:50:27.842337 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6bfa643c-7aa5-4e32-8c6f-3fe02960c13d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Going to try to terminate instance {{(pid=124947) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:50:27.851285 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-37d5f5e0-b0d8-44a7-89fd-0827047e60e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:27.852156 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-37d5f5e0-b0d8-44a7-89fd-0827047e60e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:27.858323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-37d5f5e0-b0d8-44a7-89fd-0827047e60e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:27.858784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-37d5f5e0-b0d8-44a7-89fd-0827047e60e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:27.859546 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-37d5f5e0-b0d8-44a7-89fd-0827047e60e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:27.865903 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-37d5f5e0-b0d8-44a7-89fd-0827047e60e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:27.943263 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-37d5f5e0-b0d8-44a7-89fd-0827047e60e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] HTTP exception thrown: Instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 is not attached to volume 40c4da5d-6fda-434f-bcc3-c00257402c06 Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-37d5f5e0-b0d8-44a7-89fd-0827047e60e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Request method failure captured: Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: DELETE /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments/40c4da5d-6fda-434f-bcc3-c00257402c06 HTTP/1.1 Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AJUhLsEWJ-Pq55CRB8h2IV2OIQWd2xXbzN8H9Adbp-C2aiABmxz8w5Q4nhsKsWLiGHLdIb93KNUAdPZJ0CTby2XUuj5HrSnytMadjVLvkY1bnxxzGGMqqTuvfqxxOKh-fDMbd9YElUi3RA6Bf9bIW0qry2QolqtiohxS-yQ_iLs3jA Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: dc22323158714269b0da2b01121fe3ed Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-TestMinimumBasicScenario-1138489193 Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:50:27.950545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:50:27.952071 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc22323158714269b0da2b01121fe3ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc22323158714269b0da2b01121fe3ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc22323158714269b0da2b01121fe3ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc22323158714269b0da2b01121fe3ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:27.952071 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-TestMinimumBasicScenario-1138489193 Jul 14 11:50:27.952071 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: dc22323158714269b0da2b01121fe3ed Jul 14 11:50:27.952071 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1138489193 Jul 14 11:50:27.952071 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-TestMinimumBasicScenario-1138489193-project Jul 14 11:50:27.952071 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:50:27.952071 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:50:27.952071 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 59ebb8f1e98d40c9aea425fad464f1e3 Jul 14 11:50:27.952071 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-TestMinimumBasicScenario-1138489193-project Jul 14 11:50:27.952071 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:50:27.952071 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 is not attached to volume 40c4da5d-6fda-434f-bcc3-c00257402c06 Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'server_id': '88440aae-c9af-4f69-bdae-38f9d81c06a7', 'id': '40c4da5d-6fda-434f-bcc3-c00257402c06'} Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 40c4da5d-6fda-434f-bcc3-c00257402c06. Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:27.952950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:27.954404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:27.954404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 11:50:27.954404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 11:50:27.954404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 is not attached to volume 40c4da5d-6fda-434f-bcc3-c00257402c06 Jul 14 11:50:27.954404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:27.954404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:27.954404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:27.954404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:27.954404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:27.954404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:27.954404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:27.954404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:27.954404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 is not attached to volume 40c4da5d-6fda-434f-bcc3-c00257402c06 Jul 14 11:50:27.954404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:27.954404 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-37d5f5e0-b0d8-44a7-89fd-0827047e60e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Returning 404 to user: Instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 is not attached to volume 40c4da5d-6fda-434f-bcc3-c00257402c06 {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:27.956097 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-37d5f5e0-b0d8-44a7-89fd-0827047e60e8 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "DELETE /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments/40c4da5d-6fda-434f-bcc3-c00257402c06" status: 404 len: 154 microversion: 2.1 time: 0.104915 Jul 14 11:50:27.956097 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 415/872] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 11:50:27 2022] DELETE /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7/os-volume_attachments/40c4da5d-6fda-434f-bcc3-c00257402c06 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:50:28.268197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6bfa643c-7aa5-4e32-8c6f-3fe02960c13d tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "DELETE /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 204 len: 0 microversion: 2.1 time: 0.467115 Jul 14 11:50:28.274581 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 458/873] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:50:27 2022] DELETE /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:50:28.279557 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-30402a00-40d9-4731-8838-896d4d7b911f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:28.280164 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-30402a00-40d9-4731-8838-896d4d7b911f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:28.286556 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-30402a00-40d9-4731-8838-896d4d7b911f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:28.286986 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-30402a00-40d9-4731-8838-896d4d7b911f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:28.287744 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-30402a00-40d9-4731-8838-896d4d7b911f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:28.288175 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-30402a00-40d9-4731-8838-896d4d7b911f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:28.452983 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-704fb0ae-bca4-42a8-bcae-bf8d76a2755d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:28.453779 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-704fb0ae-bca4-42a8-bcae-bf8d76a2755d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:28.460275 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-704fb0ae-bca4-42a8-bcae-bf8d76a2755d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:28.460703 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-704fb0ae-bca4-42a8-bcae-bf8d76a2755d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:28.461587 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-704fb0ae-bca4-42a8-bcae-bf8d76a2755d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:28.462304 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-704fb0ae-bca4-42a8-bcae-bf8d76a2755d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:28.514003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-30402a00-40d9-4731-8838-896d4d7b911f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:28.526709 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-30402a00-40d9-4731-8838-896d4d7b911f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1680 microversion: 2.1 time: 0.250898 Jul 14 11:50:28.527763 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 416/874] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:28 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1680 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:28.611298 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-61a9d30f-a00a-40d3-82bd-018fe064fe29 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:28.612396 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-61a9d30f-a00a-40d3-82bd-018fe064fe29 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:28.618659 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-61a9d30f-a00a-40d3-82bd-018fe064fe29 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:28.621730 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-61a9d30f-a00a-40d3-82bd-018fe064fe29 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:28.621730 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-61a9d30f-a00a-40d3-82bd-018fe064fe29 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:28.621730 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-61a9d30f-a00a-40d3-82bd-018fe064fe29 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:28.626445 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-704fb0ae-bca4-42a8-bcae-bf8d76a2755d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:28.635053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-704fb0ae-bca4-42a8-bcae-bf8d76a2755d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:28.636817 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-704fb0ae-bca4-42a8-bcae-bf8d76a2755d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:28.638021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-704fb0ae-bca4-42a8-bcae-bf8d76a2755d tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1718 microversion: 2.20 time: 0.189664 Jul 14 11:50:28.638783 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 459/875] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:50:28 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1718 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:50:28.662611 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-61a9d30f-a00a-40d3-82bd-018fe064fe29 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055941 Jul 14 11:50:28.663188 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 417/876] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:50:28 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 11:50:28.782769 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-33f02dd8-ab7b-4b0f-9d81-8b4b55ba230c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:28.783730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-33f02dd8-ab7b-4b0f-9d81-8b4b55ba230c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:28.790847 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-33f02dd8-ab7b-4b0f-9d81-8b4b55ba230c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:28.791294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-33f02dd8-ab7b-4b0f-9d81-8b4b55ba230c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:28.792147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-33f02dd8-ab7b-4b0f-9d81-8b4b55ba230c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:28.792783 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-33f02dd8-ab7b-4b0f-9d81-8b4b55ba230c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:28.836305 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-33f02dd8-ab7b-4b0f-9d81-8b4b55ba230c tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058231 Jul 14 11:50:28.841709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 460/877] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 11:50:28 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:50:28.933789 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-70a79f0c-8290-4bdf-a2a7-bd3caa880c4b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:28.936198 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-70a79f0c-8290-4bdf-a2a7-bd3caa880c4b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:28.943529 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-70a79f0c-8290-4bdf-a2a7-bd3caa880c4b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:28.944231 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-70a79f0c-8290-4bdf-a2a7-bd3caa880c4b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:28.945227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-70a79f0c-8290-4bdf-a2a7-bd3caa880c4b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:28.945863 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-70a79f0c-8290-4bdf-a2a7-bd3caa880c4b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:28.995486 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-70a79f0c-8290-4bdf-a2a7-bd3caa880c4b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Going to try to terminate instance {{(pid=124946) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:50:29.285455 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-70a79f0c-8290-4bdf-a2a7-bd3caa880c4b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 204 len: 0 microversion: 2.1 time: 0.355669 Jul 14 11:50:29.286049 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 418/878] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:50:28 2022] DELETE /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:50:29.294244 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-818541e1-a8ff-471e-bb63-eba63bd8c51b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:29.298404 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-818541e1-a8ff-471e-bb63-eba63bd8c51b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:29.301051 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-818541e1-a8ff-471e-bb63-eba63bd8c51b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:29.301548 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-818541e1-a8ff-471e-bb63-eba63bd8c51b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:29.302451 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-818541e1-a8ff-471e-bb63-eba63bd8c51b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:29.302902 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-818541e1-a8ff-471e-bb63-eba63bd8c51b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:29.328268 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:29.356413 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-dd9f5afc-87b7-47ad-ab7a-08c8346451fa tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:29.359799 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-dd9f5afc-87b7-47ad-ab7a-08c8346451fa tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:29.366834 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd9f5afc-87b7-47ad-ab7a-08c8346451fa tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:29.367624 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd9f5afc-87b7-47ad-ab7a-08c8346451fa tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:29.368631 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd9f5afc-87b7-47ad-ab7a-08c8346451fa tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:29.369337 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dd9f5afc-87b7-47ad-ab7a-08c8346451fa tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:29.406062 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-dd9f5afc-87b7-47ad-ab7a-08c8346451fa tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Going to try to terminate instance {{(pid=124946) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:50:29.459957 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-818541e1-a8ff-471e-bb63-eba63bd8c51b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:29.467886 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-818541e1-a8ff-471e-bb63-eba63bd8c51b tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1672 microversion: 2.1 time: 0.177589 Jul 14 11:50:29.468459 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 461/879] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:29 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1672 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:29.544910 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-759ef29e-c7f3-442b-af35-76c60b5aacfa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:29.545599 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-759ef29e-c7f3-442b-af35-76c60b5aacfa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:29.552292 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-759ef29e-c7f3-442b-af35-76c60b5aacfa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:29.552736 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-759ef29e-c7f3-442b-af35-76c60b5aacfa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:29.554358 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-759ef29e-c7f3-442b-af35-76c60b5aacfa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:29.554805 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-759ef29e-c7f3-442b-af35-76c60b5aacfa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:29.695747 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-759ef29e-c7f3-442b-af35-76c60b5aacfa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:29.703393 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-759ef29e-c7f3-442b-af35-76c60b5aacfa tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1680 microversion: 2.1 time: 0.162674 Jul 14 11:50:29.703974 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 462/880] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:29 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:29.729266 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-dd9f5afc-87b7-47ad-ab7a-08c8346451fa tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "DELETE /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 204 len: 0 microversion: 2.1 time: 0.376542 Jul 14 11:50:29.730715 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 419/881] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:50:29 2022] DELETE /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:50:29.746185 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-27f2e5b1-87d5-40ee-bf57-35c52fdbbea4 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:29.748012 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-27f2e5b1-87d5-40ee-bf57-35c52fdbbea4 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:29.755024 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-27f2e5b1-87d5-40ee-bf57-35c52fdbbea4 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:29.755476 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-27f2e5b1-87d5-40ee-bf57-35c52fdbbea4 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:29.756261 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-27f2e5b1-87d5-40ee-bf57-35c52fdbbea4 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:29.756892 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-27f2e5b1-87d5-40ee-bf57-35c52fdbbea4 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:29.903610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-27f2e5b1-87d5-40ee-bf57-35c52fdbbea4 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:29.911694 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-27f2e5b1-87d5-40ee-bf57-35c52fdbbea4 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1553 microversion: 2.1 time: 0.169425 Jul 14 11:50:29.912272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 463/882] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:29 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:30.488124 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-43725429-2205-4cad-81cd-a31bb2588882 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:30.488511 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-43725429-2205-4cad-81cd-a31bb2588882 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:30.497326 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-43725429-2205-4cad-81cd-a31bb2588882 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:30.497858 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-43725429-2205-4cad-81cd-a31bb2588882 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:30.501520 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-43725429-2205-4cad-81cd-a31bb2588882 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:30.501520 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-43725429-2205-4cad-81cd-a31bb2588882 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:30.643000 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-43725429-2205-4cad-81cd-a31bb2588882 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:30.651454 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-43725429-2205-4cad-81cd-a31bb2588882 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1672 microversion: 2.1 time: 0.169949 Jul 14 11:50:30.652579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 420/883] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:30 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:30.720081 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1235c349-6cdf-48c7-9f91-54c440e23d1b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:30.720686 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1235c349-6cdf-48c7-9f91-54c440e23d1b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:30.726729 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1235c349-6cdf-48c7-9f91-54c440e23d1b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:30.727206 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1235c349-6cdf-48c7-9f91-54c440e23d1b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:30.727934 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1235c349-6cdf-48c7-9f91-54c440e23d1b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:30.728363 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1235c349-6cdf-48c7-9f91-54c440e23d1b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:30.928532 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ed9b23e4-5884-4e7d-9b55-9e5d7e4c696e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:30.929821 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ed9b23e4-5884-4e7d-9b55-9e5d7e4c696e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:30.936249 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ed9b23e4-5884-4e7d-9b55-9e5d7e4c696e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:30.936863 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ed9b23e4-5884-4e7d-9b55-9e5d7e4c696e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:30.937830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ed9b23e4-5884-4e7d-9b55-9e5d7e4c696e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:30.938366 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ed9b23e4-5884-4e7d-9b55-9e5d7e4c696e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:30.980872 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1235c349-6cdf-48c7-9f91-54c440e23d1b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:30.992845 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1235c349-6cdf-48c7-9f91-54c440e23d1b tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1680 microversion: 2.1 time: 0.276694 Jul 14 11:50:31.001816 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 464/884] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:30 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1680 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:31.098426 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ed9b23e4-5884-4e7d-9b55-9e5d7e4c696e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:31.106044 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ed9b23e4-5884-4e7d-9b55-9e5d7e4c696e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1553 microversion: 2.1 time: 0.181562 Jul 14 11:50:31.106710 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 421/885] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:30 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1553 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:50:31.668558 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a82492a6-3556-4dc1-85b2-3056dd2126d1 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:31.669189 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a82492a6-3556-4dc1-85b2-3056dd2126d1 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:31.675969 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a82492a6-3556-4dc1-85b2-3056dd2126d1 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:31.676409 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a82492a6-3556-4dc1-85b2-3056dd2126d1 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:31.677194 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a82492a6-3556-4dc1-85b2-3056dd2126d1 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:31.677628 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a82492a6-3556-4dc1-85b2-3056dd2126d1 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:31.813960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a82492a6-3556-4dc1-85b2-3056dd2126d1 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:31.821559 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a82492a6-3556-4dc1-85b2-3056dd2126d1 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1672 microversion: 2.1 time: 0.156790 Jul 14 11:50:31.822211 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 465/886] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:31 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:32.010608 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9e4aa8cc-d2c3-405f-9872-d57eab38f088 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:32.014246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9e4aa8cc-d2c3-405f-9872-d57eab38f088 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:32.018237 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9e4aa8cc-d2c3-405f-9872-d57eab38f088 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:32.018632 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9e4aa8cc-d2c3-405f-9872-d57eab38f088 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:32.019521 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9e4aa8cc-d2c3-405f-9872-d57eab38f088 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:32.019922 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9e4aa8cc-d2c3-405f-9872-d57eab38f088 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:32.122663 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-14dcc2ad-4f22-4a12-8c82-8f0b24b8d7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:32.123280 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-14dcc2ad-4f22-4a12-8c82-8f0b24b8d7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:32.129277 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-14dcc2ad-4f22-4a12-8c82-8f0b24b8d7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:32.129736 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-14dcc2ad-4f22-4a12-8c82-8f0b24b8d7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:32.130521 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-14dcc2ad-4f22-4a12-8c82-8f0b24b8d7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:32.130962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-14dcc2ad-4f22-4a12-8c82-8f0b24b8d7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:32.164395 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9e4aa8cc-d2c3-405f-9872-d57eab38f088 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:32.172195 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9e4aa8cc-d2c3-405f-9872-d57eab38f088 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1680 microversion: 2.1 time: 0.165604 Jul 14 11:50:32.173521 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 422/887] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:32 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:32.261831 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-14dcc2ad-4f22-4a12-8c82-8f0b24b8d7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:32.269582 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-14dcc2ad-4f22-4a12-8c82-8f0b24b8d7b7 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1553 microversion: 2.1 time: 0.150661 Jul 14 11:50:32.270307 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 466/888] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:32 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:50:32.838768 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-56f6627f-d4a0-410a-a85f-33c0a682e258 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:32.839385 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-56f6627f-d4a0-410a-a85f-33c0a682e258 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:32.851887 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-56f6627f-d4a0-410a-a85f-33c0a682e258 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:32.852349 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-56f6627f-d4a0-410a-a85f-33c0a682e258 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:32.853151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-56f6627f-d4a0-410a-a85f-33c0a682e258 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:32.853964 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-56f6627f-d4a0-410a-a85f-33c0a682e258 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:33.197206 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7d620c7e-345e-41d2-af8e-4159aea48611 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:33.206576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-56f6627f-d4a0-410a-a85f-33c0a682e258 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:33.212367 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7d620c7e-345e-41d2-af8e-4159aea48611 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:33.229460 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-56f6627f-d4a0-410a-a85f-33c0a682e258 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1672 microversion: 2.1 time: 0.392118 Jul 14 11:50:33.233539 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 423/889] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:32 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1672 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:33.238048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7d620c7e-345e-41d2-af8e-4159aea48611 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:33.239723 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7d620c7e-345e-41d2-af8e-4159aea48611 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:33.240549 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7d620c7e-345e-41d2-af8e-4159aea48611 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:33.242102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7d620c7e-345e-41d2-af8e-4159aea48611 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:33.287368 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6b116cf2-74c2-480c-99ed-accc3840382e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:33.288048 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6b116cf2-74c2-480c-99ed-accc3840382e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:33.294642 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6b116cf2-74c2-480c-99ed-accc3840382e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:33.295099 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6b116cf2-74c2-480c-99ed-accc3840382e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:33.296271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6b116cf2-74c2-480c-99ed-accc3840382e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:33.296715 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6b116cf2-74c2-480c-99ed-accc3840382e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:33.525601 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7d620c7e-345e-41d2-af8e-4159aea48611 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:33.538240 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7d620c7e-345e-41d2-af8e-4159aea48611 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1680 microversion: 2.1 time: 0.350486 Jul 14 11:50:33.539690 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 467/890] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:33 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1680 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:33.544823 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-2fa952ce-ac6a-4215-b974-1280734c8b32 req-bdfa0fc7-69f4-4932-84fe-0cc9fd3f039c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046cf283-3c75-404b-b0a5-47ff4e2b9b38", "name": "network-vif-unplugged", "status": "completed", "tag": "2bf88cae-cdc5-4206-8a26-2e2997ddefac"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:33.558689 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-2fa952ce-ac6a-4215-b974-1280734c8b32 req-bdfa0fc7-69f4-4932-84fe-0cc9fd3f039c service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:33.559126 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-2fa952ce-ac6a-4215-b974-1280734c8b32 req-bdfa0fc7-69f4-4932-84fe-0cc9fd3f039c service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:33.571668 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-2fa952ce-ac6a-4215-b974-1280734c8b32 req-bdfa0fc7-69f4-4932-84fe-0cc9fd3f039c service nova] Creating event network-vif-unplugged:2bf88cae-cdc5-4206-8a26-2e2997ddefac for instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 on hv-cinder-84980 Jul 14 11:50:33.576726 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-2fa952ce-ac6a-4215-b974-1280734c8b32 req-bdfa0fc7-69f4-4932-84fe-0cc9fd3f039c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035114 Jul 14 11:50:33.577434 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 468/891] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:33.612545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6b116cf2-74c2-480c-99ed-accc3840382e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:33.620626 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6b116cf2-74c2-480c-99ed-accc3840382e tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1553 microversion: 2.1 time: 0.337628 Jul 14 11:50:33.621227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 424/892] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:33 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1553 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:50:34.090178 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-551ddd37-d981-476b-9362-15674b22c828 req-649c3c03-740a-47d8-aa54-1f1e23bd0c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88440aae-c9af-4f69-bdae-38f9d81c06a7", "name": "network-vif-deleted", "tag": "f79bdd51-95b5-4720-a060-677fe13019be"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:34.101496 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-551ddd37-d981-476b-9362-15674b22c828 req-649c3c03-740a-47d8-aa54-1f1e23bd0c70 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:34.102462 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-551ddd37-d981-476b-9362-15674b22c828 req-649c3c03-740a-47d8-aa54-1f1e23bd0c70 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:34.114019 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-551ddd37-d981-476b-9362-15674b22c828 req-649c3c03-740a-47d8-aa54-1f1e23bd0c70 service nova] Creating event network-vif-deleted:f79bdd51-95b5-4720-a060-677fe13019be for instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 on hv-cinder-84980 Jul 14 11:50:34.121566 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-551ddd37-d981-476b-9362-15674b22c828 req-649c3c03-740a-47d8-aa54-1f1e23bd0c70 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035613 Jul 14 11:50:34.122214 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 469/893] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:34.251365 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-fb1e9c9d-6d2f-4f7c-8351-0d6c57cdf592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:34.252210 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-fb1e9c9d-6d2f-4f7c-8351-0d6c57cdf592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:34.264148 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fb1e9c9d-6d2f-4f7c-8351-0d6c57cdf592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:34.265243 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fb1e9c9d-6d2f-4f7c-8351-0d6c57cdf592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:34.266855 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fb1e9c9d-6d2f-4f7c-8351-0d6c57cdf592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:34.267456 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fb1e9c9d-6d2f-4f7c-8351-0d6c57cdf592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:34.374527 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-fb1e9c9d-6d2f-4f7c-8351-0d6c57cdf592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:34.385348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-f012e8f5-7271-4b66-95e7-7cb7c8ab4112 req-4a61c46b-fe06-491f-b5db-4482d5bc2710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046cf283-3c75-404b-b0a5-47ff4e2b9b38", "name": "network-vif-deleted", "tag": "2bf88cae-cdc5-4206-8a26-2e2997ddefac"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:34.385859 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-fb1e9c9d-6d2f-4f7c-8351-0d6c57cdf592 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1605 microversion: 2.1 time: 0.138152 Jul 14 11:50:34.386403 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 470/894] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:34 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1605 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:34.389964 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:34.406281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-f012e8f5-7271-4b66-95e7-7cb7c8ab4112 req-4a61c46b-fe06-491f-b5db-4482d5bc2710 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:34.408030 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-f012e8f5-7271-4b66-95e7-7cb7c8ab4112 req-4a61c46b-fe06-491f-b5db-4482d5bc2710 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:34.449267 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-f012e8f5-7271-4b66-95e7-7cb7c8ab4112 req-4a61c46b-fe06-491f-b5db-4482d5bc2710 service nova] Creating event network-vif-deleted:2bf88cae-cdc5-4206-8a26-2e2997ddefac for instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 on hv-cinder-84980 Jul 14 11:50:34.451843 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-f012e8f5-7271-4b66-95e7-7cb7c8ab4112 req-4a61c46b-fe06-491f-b5db-4482d5bc2710 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.298059 Jul 14 11:50:34.452533 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 425/895] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:34.556049 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1bc4086e-fdb6-43de-9b7b-e382c37e9036 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:34.558857 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1bc4086e-fdb6-43de-9b7b-e382c37e9036 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:34.576332 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1bc4086e-fdb6-43de-9b7b-e382c37e9036 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:34.576939 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1bc4086e-fdb6-43de-9b7b-e382c37e9036 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:34.595152 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1bc4086e-fdb6-43de-9b7b-e382c37e9036 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:34.597966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1bc4086e-fdb6-43de-9b7b-e382c37e9036 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:34.639105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9e70e9f3-6285-43a1-8066-c1283e447888 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:34.641063 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9e70e9f3-6285-43a1-8066-c1283e447888 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:34.656410 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9e70e9f3-6285-43a1-8066-c1283e447888 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:34.656410 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9e70e9f3-6285-43a1-8066-c1283e447888 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:34.656410 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9e70e9f3-6285-43a1-8066-c1283e447888 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:34.656410 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9e70e9f3-6285-43a1-8066-c1283e447888 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:34.664675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1bc4086e-fdb6-43de-9b7b-e382c37e9036 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:34.667567 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1bc4086e-fdb6-43de-9b7b-e382c37e9036 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:34.668167 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-1bc4086e-fdb6-43de-9b7b-e382c37e9036 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lazy-loading 'fault' on Instance uuid 046cf283-3c75-404b-b0a5-47ff4e2b9b38 {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:50:34.734633 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1bc4086e-fdb6-43de-9b7b-e382c37e9036 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8773c88f88614a9d903f667305a217e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f274d555f5c746cc885394c699b3d767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:34.741044 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9e70e9f3-6285-43a1-8066-c1283e447888 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:34.741924 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9e70e9f3-6285-43a1-8066-c1283e447888 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:34.742600 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-9e70e9f3-6285-43a1-8066-c1283e447888 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lazy-loading 'fault' on Instance uuid 88440aae-c9af-4f69-bdae-38f9d81c06a7 {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:50:34.745106 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1bc4086e-fdb6-43de-9b7b-e382c37e9036 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 200 len: 1330 microversion: 2.1 time: 0.193003 Jul 14 11:50:34.755599 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 471/896] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:34 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 1330 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:50:34.841932 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9e70e9f3-6285-43a1-8066-c1283e447888 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ebb8f1e98d40c9aea425fad464f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc22323158714269b0da2b01121fe3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:34.844976 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:34.851682 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9e70e9f3-6285-43a1-8066-c1283e447888 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 200 len: 1347 microversion: 2.1 time: 0.217516 Jul 14 11:50:34.863417 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 426/897] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:34 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 1347 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:34.967679 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-fc88fad2-58e9-4a42-a14c-3177d8b6e6f6 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] Calling method '.version_select at 0x7f1adf5a1550>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:35.026312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-fc88fad2-58e9-4a42-a14c-3177d8b6e6f6 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/11b5fc6a-4aa2-4bad-a3a2-9b1eaa3d6218" status: 200 len: 350 microversion: 2.1 time: 0.062616 Jul 14 11:50:35.026909 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 472/898] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 11:50:34 2022] GET /compute/v2.1/os-volumes/11b5fc6a-4aa2-4bad-a3a2-9b1eaa3d6218 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:35.405378 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d619c6a3-00ba-4ae3-93a2-98a7e137047d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:35.406153 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d619c6a3-00ba-4ae3-93a2-98a7e137047d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:35.420133 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d619c6a3-00ba-4ae3-93a2-98a7e137047d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:35.420841 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d619c6a3-00ba-4ae3-93a2-98a7e137047d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:35.422169 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d619c6a3-00ba-4ae3-93a2-98a7e137047d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:35.423396 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d619c6a3-00ba-4ae3-93a2-98a7e137047d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:35.468269 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d619c6a3-00ba-4ae3-93a2-98a7e137047d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:35.470076 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d619c6a3-00ba-4ae3-93a2-98a7e137047d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:35.470714 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-d619c6a3-00ba-4ae3-93a2-98a7e137047d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lazy-loading 'fault' on Instance uuid 4a9a7ce6-aede-493e-8e91-b35f4c51d954 {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:50:35.516879 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d619c6a3-00ba-4ae3-93a2-98a7e137047d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246f07024efa444da74f2b898f426b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a88ac7db8a481ca03508d315a0bc56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:50:35.526687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d619c6a3-00ba-4ae3-93a2-98a7e137047d tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 200 len: 1326 microversion: 2.1 time: 0.125204 Jul 14 11:50:35.527230 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 427/899] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:35 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 1326 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:35.764859 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2f17e4cd-2863-4bb6-916d-1f025ea6a09c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:35.766077 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2f17e4cd-2863-4bb6-916d-1f025ea6a09c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:35.773057 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2f17e4cd-2863-4bb6-916d-1f025ea6a09c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:35.773556 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2f17e4cd-2863-4bb6-916d-1f025ea6a09c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:35.774352 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2f17e4cd-2863-4bb6-916d-1f025ea6a09c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:35.774787 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2f17e4cd-2863-4bb6-916d-1f025ea6a09c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:35.800980 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-2f17e4cd-2863-4bb6-916d-1f025ea6a09c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] HTTP exception thrown: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2f17e4cd-2863-4bb6-916d-1f025ea6a09c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Request method failure captured: Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 HTTP/1.1 Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AGNrCXQELDmNK7QTgAsdlJtPBM_GXw3pFQ92I5FXg_Nl7xnN8erDQ0jD6cBgqZwNWgSGDIvH_OU-IJPWW0i2GmYKcnE8wD4a47a9DJeOO5JgDloTkiJ3A6EcxYhG-symYmW7J8b_ws3S47CzQaA9KAgAK_QrTjwz8qGsPABa7uBQLs Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:50:35.805670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:50:35.807824 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f274d555f5c746cc885394c699b3d767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f274d555f5c746cc885394c699b3d767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:35.807824 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:35.807824 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:35.807824 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:35.807824 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:35.807824 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:50:35.807824 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:50:35.807824 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 8773c88f88614a9d903f667305a217e0 Jul 14 11:50:35.807824 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:35.807824 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:50:35.807824 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. Jul 14 11:50:35.807824 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': '046cf283-3c75-404b-b0a5-47ff4e2b9b38'} Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:35.808761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. Jul 14 11:50:35.810960 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:35.812546 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2f17e4cd-2863-4bb6-916d-1f025ea6a09c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Returning 404 to user: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:35.812546 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2f17e4cd-2863-4bb6-916d-1f025ea6a09c tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 404 len: 111 microversion: 2.1 time: 0.043947 Jul 14 11:50:35.812546 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 473/900] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:35 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:35.815219 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d5a50b2e-e49d-49ae-ab06-bf3b4adcf9c7 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '.version_select at 0x7f1adf658f70>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:35.871534 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d5b7128c-a62a-4e3c-b630-5388c226ec05 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:35.872149 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d5b7128c-a62a-4e3c-b630-5388c226ec05 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] [instance: 88440aae-c9af-4f69-bdae-38f9d81c06a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:35.878295 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5b7128c-a62a-4e3c-b630-5388c226ec05 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:35.878749 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5b7128c-a62a-4e3c-b630-5388c226ec05 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:35.879527 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5b7128c-a62a-4e3c-b630-5388c226ec05 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:35.879967 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d5b7128c-a62a-4e3c-b630-5388c226ec05 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:35.898288 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-d5b7128c-a62a-4e3c-b630-5388c226ec05 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] HTTP exception thrown: Instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 could not be found. Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d5b7128c-a62a-4e3c-b630-5388c226ec05 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Request method failure captured: Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 HTTP/1.1 Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AJUhLsEWJ-Pq55CRB8h2IV2OIQWd2xXbzN8H9Adbp-C2aiABmxz8w5Q4nhsKsWLiGHLdIb93KNUAdPZJ0CTby2XUuj5HrSnytMadjVLvkY1bnxxzGGMqqTuvfqxxOKh-fDMbd9YElUi3RA6Bf9bIW0qry2QolqtiohxS-yQ_iLs3jA Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: dc22323158714269b0da2b01121fe3ed Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-TestMinimumBasicScenario-1138489193 Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:50:35.899833 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:50:35.901220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc22323158714269b0da2b01121fe3ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc22323158714269b0da2b01121fe3ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc22323158714269b0da2b01121fe3ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc22323158714269b0da2b01121fe3ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:35.901220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-TestMinimumBasicScenario-1138489193 Jul 14 11:50:35.901220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: dc22323158714269b0da2b01121fe3ed Jul 14 11:50:35.901220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1138489193 Jul 14 11:50:35.901220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-TestMinimumBasicScenario-1138489193-project Jul 14 11:50:35.901220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:50:35.901220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:50:35.901220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 59ebb8f1e98d40c9aea425fad464f1e3 Jul 14 11:50:35.901220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-TestMinimumBasicScenario-1138489193-project Jul 14 11:50:35.901220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:50:35.901220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 could not be found. Jul 14 11:50:35.901220 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': '88440aae-c9af-4f69-bdae-38f9d81c06a7'} Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 could not be found. Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:35.902037 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 could not be found. Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 could not be found. Jul 14 11:50:35.903400 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:35.904520 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d5b7128c-a62a-4e3c-b630-5388c226ec05 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Returning 404 to user: Instance 88440aae-c9af-4f69-bdae-38f9d81c06a7 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:35.904520 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d5b7128c-a62a-4e3c-b630-5388c226ec05 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7" status: 404 len: 111 microversion: 2.1 time: 0.033614 Jul 14 11:50:35.904520 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 474/901] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:35 2022] GET /compute/v2.1/servers/88440aae-c9af-4f69-bdae-38f9d81c06a7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:50:35.913874 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-266150e7-25fe-4945-9a31-6dcacb7c9423 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] Calling method '.version_select at 0x7f1adf66edc0>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:35.943097 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d5a50b2e-e49d-49ae-ab06-bf3b4adcf9c7 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-299555300" status: 202 len: 0 microversion: 2.1 time: 0.133586 Jul 14 11:50:35.943728 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 428/902] 10.222.0.40 () {58 vars in 1217 bytes} [Thu Jul 14 11:50:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-299555300 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:50:36.028453 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-266150e7-25fe-4945-9a31-6dcacb7c9423 tempest-TestMinimumBasicScenario-1138489193 tempest-TestMinimumBasicScenario-1138489193-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-65159567" status: 202 len: 0 microversion: 2.1 time: 0.118407 Jul 14 11:50:36.029065 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 475/903] 10.222.0.40 () {58 vars in 1265 bytes} [Thu Jul 14 11:50:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-65159567 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:50:36.137686 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-081fb500-efea-47f5-8079-6538cc5e5398 req-d54a9191-7330-49f8-84f8-af3fe542adfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a9a7ce6-aede-493e-8e91-b35f4c51d954", "name": "network-vif-deleted", "tag": "9e3c7542-e076-4781-be94-f9cf16cf7f57"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:36.147018 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-081fb500-efea-47f5-8079-6538cc5e5398 req-d54a9191-7330-49f8-84f8-af3fe542adfa service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:36.147707 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-081fb500-efea-47f5-8079-6538cc5e5398 req-d54a9191-7330-49f8-84f8-af3fe542adfa service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:36.160947 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-081fb500-efea-47f5-8079-6538cc5e5398 req-d54a9191-7330-49f8-84f8-af3fe542adfa service nova] Creating event network-vif-deleted:9e3c7542-e076-4781-be94-f9cf16cf7f57 for instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 on hv-cinder-84980 Jul 14 11:50:36.165858 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-081fb500-efea-47f5-8079-6538cc5e5398 req-d54a9191-7330-49f8-84f8-af3fe542adfa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032448 Jul 14 11:50:36.166495 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 429/904] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:36.544130 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-05d0fab2-d140-4f4c-9645-a1d60a67fa26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:36.544765 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-05d0fab2-d140-4f4c-9645-a1d60a67fa26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:36.551533 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-05d0fab2-d140-4f4c-9645-a1d60a67fa26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:36.551987 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-05d0fab2-d140-4f4c-9645-a1d60a67fa26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:36.552765 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-05d0fab2-d140-4f4c-9645-a1d60a67fa26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:36.553234 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-05d0fab2-d140-4f4c-9645-a1d60a67fa26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:36.567378 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-05d0fab2-d140-4f4c-9645-a1d60a67fa26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] HTTP exception thrown: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-05d0fab2-d140-4f4c-9645-a1d60a67fa26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Request method failure captured: Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 HTTP/1.1 Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AGIz-VVLj5Cn2FeK00spv5i4jycBYb48_psBZTc_hmV4y6eMDaZWost2EUEADSFG1X7rj_Tcbaj1sKJtsRnV5j0rnlTB6MsL2L3ilmuBAkJH4UHaAsls8Zsz4k6CRGrV3bT6szT_JYs4JSJlP56caFYRnZ_t9VH7-GDIQxW2qkXUJE Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 48a88ac7db8a481ca03508d315a0bc56 Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:50:36.570920 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:50:36.572935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:36.572935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:50:36.572935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 48a88ac7db8a481ca03508d315a0bc56 Jul 14 11:50:36.572935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:50:36.572935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-AttachVolumeTestJSON-1543342879-project Jul 14 11:50:36.572935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:50:36.572935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:50:36.572935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 246f07024efa444da74f2b898f426b46 Jul 14 11:50:36.572935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-AttachVolumeTestJSON-1543342879-project Jul 14 11:50:36.572935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:50:36.572935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. Jul 14 11:50:36.572935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': '4a9a7ce6-aede-493e-8e91-b35f4c51d954'} Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:36.573962 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. Jul 14 11:50:36.575340 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:36.577047 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-05d0fab2-d140-4f4c-9645-a1d60a67fa26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Returning 404 to user: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:36.577047 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-05d0fab2-d140-4f4c-9645-a1d60a67fa26 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 404 len: 111 microversion: 2.1 time: 0.030521 Jul 14 11:50:36.577047 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 476/905] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:36 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:36.580578 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-865a5a9d-1729-4ddf-bbb1-9ddb45ccc013 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '.version_select at 0x7f1adf658430>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:36.711784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-865a5a9d-1729-4ddf-bbb1-9ddb45ccc013 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-386723855" status: 202 len: 0 microversion: 2.1 time: 0.135844 Jul 14 11:50:36.712659 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 430/906] 10.222.0.40 () {58 vars in 1217 bytes} [Thu Jul 14 11:50:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-386723855 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:50:36.773326 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-97ca1f1f-a3ea-489b-a485-bb3e9686a184 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] Calling method '.version_select at 0x7f1adf56bb80>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:36.828803 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-97ca1f1f-a3ea-489b-a485-bb3e9686a184 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/b326959c-d68a-4e74-aa14-452afaa88b7f" status: 200 len: 350 microversion: 2.1 time: 0.059526 Jul 14 11:50:36.829333 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 477/907] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 11:50:36 2022] GET /compute/v2.1/os-volumes/b326959c-d68a-4e74-aa14-452afaa88b7f => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:38.245259 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-7b79f836-71c9-46fa-921e-4c3c26a27ecf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:38.246006 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-7b79f836-71c9-46fa-921e-4c3c26a27ecf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:38.253032 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7b79f836-71c9-46fa-921e-4c3c26a27ecf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:38.253565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7b79f836-71c9-46fa-921e-4c3c26a27ecf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:38.254413 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7b79f836-71c9-46fa-921e-4c3c26a27ecf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:38.254858 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7b79f836-71c9-46fa-921e-4c3c26a27ecf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:38.271480 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-7b79f836-71c9-46fa-921e-4c3c26a27ecf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] HTTP exception thrown: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-7b79f836-71c9-46fa-921e-4c3c26a27ecf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Request method failure captured: Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: DELETE /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 HTTP/1.1 Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGNrCXQELDmNK7QTgAsdlJtPBM_GXw3pFQ92I5FXg_Nl7xnN8erDQ0jD6cBgqZwNWgSGDIvH_OU-IJPWW0i2GmYKcnE8wD4a47a9DJeOO5JgDloTkiJ3A6EcxYhG-symYmW7J8b_ws3S47CzQaA9KAgAK_QrTjwz8qGsPABa7uBQLs Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:50:38.273839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:50:38.278440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f274d555f5c746cc885394c699b3d767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f274d555f5c746cc885394c699b3d767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:38.278440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:38.278440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:38.278440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:38.278440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:38.278440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:50:38.278440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:50:38.278440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 8773c88f88614a9d903f667305a217e0 Jul 14 11:50:38.278440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:38.278440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:50:38.278440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. Jul 14 11:50:38.278440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '046cf283-3c75-404b-b0a5-47ff4e2b9b38'} Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:38.279465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. Jul 14 11:50:38.280900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:38.282894 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-7b79f836-71c9-46fa-921e-4c3c26a27ecf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Returning 404 to user: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:38.282894 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-7b79f836-71c9-46fa-921e-4c3c26a27ecf tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "DELETE /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 404 len: 111 microversion: 2.1 time: 0.035223 Jul 14 11:50:38.282894 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 431/908] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:50:38 2022] DELETE /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:38.286550 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c2a4263c-7ce3-43d6-a5e7-ad6bfaf60f66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:38.287238 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c2a4263c-7ce3-43d6-a5e7-ad6bfaf60f66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 046cf283-3c75-404b-b0a5-47ff4e2b9b38] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:38.295261 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c2a4263c-7ce3-43d6-a5e7-ad6bfaf60f66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:38.295781 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c2a4263c-7ce3-43d6-a5e7-ad6bfaf60f66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:38.296615 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c2a4263c-7ce3-43d6-a5e7-ad6bfaf60f66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:38.297117 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c2a4263c-7ce3-43d6-a5e7-ad6bfaf60f66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:38.311222 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-c2a4263c-7ce3-43d6-a5e7-ad6bfaf60f66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] HTTP exception thrown: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c2a4263c-7ce3-43d6-a5e7-ad6bfaf60f66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Request method failure captured: Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 HTTP/1.1 Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AGNrCXQELDmNK7QTgAsdlJtPBM_GXw3pFQ92I5FXg_Nl7xnN8erDQ0jD6cBgqZwNWgSGDIvH_OU-IJPWW0i2GmYKcnE8wD4a47a9DJeOO5JgDloTkiJ3A6EcxYhG-symYmW7J8b_ws3S47CzQaA9KAgAK_QrTjwz8qGsPABa7uBQLs Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:50:38.313010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:50:38.314688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f274d555f5c746cc885394c699b3d767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f274d555f5c746cc885394c699b3d767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:38.314688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:38.314688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:38.314688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:38.314688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:38.314688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:50:38.314688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:50:38.314688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 8773c88f88614a9d903f667305a217e0 Jul 14 11:50:38.314688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:38.314688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:50:38.314688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. Jul 14 11:50:38.314688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': '046cf283-3c75-404b-b0a5-47ff4e2b9b38'} Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:38.315530 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. Jul 14 11:50:38.317650 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:38.318996 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c2a4263c-7ce3-43d6-a5e7-ad6bfaf60f66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Returning 404 to user: Instance 046cf283-3c75-404b-b0a5-47ff4e2b9b38 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:38.318996 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c2a4263c-7ce3-43d6-a5e7-ad6bfaf60f66 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38" status: 404 len: 111 microversion: 2.1 time: 0.034483 Jul 14 11:50:38.318996 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 478/909] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:38 2022] GET /compute/v2.1/servers/046cf283-3c75-404b-b0a5-47ff4e2b9b38 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:38.609834 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-60a3d073-9a20-4e05-9587-aae8d9dd9cb5 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] Calling method '.version_select at 0x7f1adf664e50>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:38.663104 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-60a3d073-9a20-4e05-9587-aae8d9dd9cb5 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/fe334dc8-3a54-44f3-99ea-e65079bf6b61" status: 200 len: 350 microversion: 2.1 time: 0.057209 Jul 14 11:50:38.663825 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 432/910] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 11:50:38 2022] GET /compute/v2.1/os-volumes/fe334dc8-3a54-44f3-99ea-e65079bf6b61 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:38.675446 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-82b3ba4a-9652-4cf9-b3d9-299eaa32a5b7 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] Calling method '.version_select at 0x7f1adf58b940>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:38.763039 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-82b3ba4a-9652-4cf9-b3d9-299eaa32a5b7 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.091800 Jul 14 11:50:38.763658 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 479/911] 10.222.0.40 () {58 vars in 1133 bytes} [Thu Jul 14 11:50:38 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:38.777117 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3b7ae3f7-5c4f-42b3-a942-cb32b49efa46 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] Calling method '.version_select at 0x7f1ae40f58b0>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:38.887179 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3b7ae3f7-5c4f-42b3-a942-cb32b49efa46 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.114233 Jul 14 11:50:38.887969 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 433/912] 10.222.0.40 () {58 vars in 1148 bytes} [Thu Jul 14 11:50:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:38.903202 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1ca4a0cb-a188-4042-ac2c-059f1aa38bc5 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] Calling method '.version_select at 0x7f1adf56bdc0>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:38.991194 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1ca4a0cb-a188-4042-ac2c-059f1aa38bc5 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.091776 Jul 14 11:50:38.991997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 480/913] 10.222.0.40 () {58 vars in 1133 bytes} [Thu Jul 14 11:50:38 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:39.003764 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6d518fb9-8c0d-4ba7-b525-49b4a5b324b3 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] Calling method '.version_select at 0x7f1adf658430>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:39.095073 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6d518fb9-8c0d-4ba7-b525-49b4a5b324b3 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.095689 Jul 14 11:50:39.105655 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 434/914] 10.222.0.40 () {58 vars in 1166 bytes} [Thu Jul 14 11:50:38 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:39.108957 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-912bf005-093f-4f65-a68c-6ca4f66affab tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] Calling method '.version_select at 0x7f1adf5bdaf0>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:39.199413 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-912bf005-093f-4f65-a68c-6ca4f66affab tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.094860 Jul 14 11:50:39.200237 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 481/915] 10.222.0.40 () {58 vars in 1169 bytes} [Thu Jul 14 11:50:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:50:39.213127 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-846b61a4-b1ad-48f5-a9b4-1772f9e9f5d8 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] Calling method '.version_select at 0x7f1adf658a60>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:39.294230 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-846b61a4-b1ad-48f5-a9b4-1772f9e9f5d8 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.085017 Jul 14 11:50:39.295120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 435/916] 10.222.0.40 () {58 vars in 1154 bytes} [Thu Jul 14 11:50:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:39.307332 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-341f2411-096a-4393-ad48-578d2d099790 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] Calling method '.version_select at 0x7f1adf5ecd30>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:39.393362 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-341f2411-096a-4393-ad48-578d2d099790 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090171 Jul 14 11:50:39.394004 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 482/917] 10.222.0.40 () {58 vars in 1187 bytes} [Thu Jul 14 11:50:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:39.406322 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-343079d9-7daf-4863-aa9d-483e1bfa0de6 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] Calling method '.version_select at 0x7f1adf489040>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:39.495874 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-343079d9-7daf-4863-aa9d-483e1bfa0de6 tempest-VolumesTestJSON-1441845105 tempest-VolumesTestJSON-1441845105-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.093660 Jul 14 11:50:39.496472 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 436/918] 10.222.0.40 () {58 vars in 1154 bytes} [Thu Jul 14 11:50:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:50:39.609047 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b028104d-0661-45ba-bbee-1fd6e37031f2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:39.609577 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b028104d-0661-45ba-bbee-1fd6e37031f2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:39.616648 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b028104d-0661-45ba-bbee-1fd6e37031f2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:39.617095 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b028104d-0661-45ba-bbee-1fd6e37031f2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:39.617901 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b028104d-0661-45ba-bbee-1fd6e37031f2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:39.618333 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b028104d-0661-45ba-bbee-1fd6e37031f2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:39.633442 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-b028104d-0661-45ba-bbee-1fd6e37031f2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] HTTP exception thrown: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b028104d-0661-45ba-bbee-1fd6e37031f2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Request method failure captured: Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: DELETE /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b HTTP/1.1 Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AGNrCXQELDmNK7QTgAsdlJtPBM_GXw3pFQ92I5FXg_Nl7xnN8erDQ0jD6cBgqZwNWgSGDIvH_OU-IJPWW0i2GmYKcnE8wD4a47a9DJeOO5JgDloTkiJ3A6EcxYhG-symYmW7J8b_ws3S47CzQaA9KAgAK_QrTjwz8qGsPABa7uBQLs Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:50:39.635075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:50:39.636605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f274d555f5c746cc885394c699b3d767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f274d555f5c746cc885394c699b3d767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:39.636605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:39.636605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:39.636605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:39.636605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:39.636605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:50:39.636605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:50:39.636605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 8773c88f88614a9d903f667305a217e0 Jul 14 11:50:39.636605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:39.636605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:50:39.636605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. Jul 14 11:50:39.636605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': '72ebe862-edb8-480e-9c0d-02a791c8160b'} Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:39.637477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. Jul 14 11:50:39.638691 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.640881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b028104d-0661-45ba-bbee-1fd6e37031f2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Returning 404 to user: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:39.641809 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b028104d-0661-45ba-bbee-1fd6e37031f2 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "DELETE /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 404 len: 111 microversion: 2.1 time: 0.036819 Jul 14 11:50:39.642643 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 483/919] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:50:39 2022] DELETE /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:39.651608 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a263a891-ab52-4f71-80da-2ca5ce841831 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:39.652536 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a263a891-ab52-4f71-80da-2ca5ce841831 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 72ebe862-edb8-480e-9c0d-02a791c8160b] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:39.660733 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a263a891-ab52-4f71-80da-2ca5ce841831 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:39.661513 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a263a891-ab52-4f71-80da-2ca5ce841831 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:39.662339 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a263a891-ab52-4f71-80da-2ca5ce841831 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:39.662779 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a263a891-ab52-4f71-80da-2ca5ce841831 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:39.678092 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-a263a891-ab52-4f71-80da-2ca5ce841831 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] HTTP exception thrown: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a263a891-ab52-4f71-80da-2ca5ce841831 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Request method failure captured: Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b HTTP/1.1 Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGNrCXQELDmNK7QTgAsdlJtPBM_GXw3pFQ92I5FXg_Nl7xnN8erDQ0jD6cBgqZwNWgSGDIvH_OU-IJPWW0i2GmYKcnE8wD4a47a9DJeOO5JgDloTkiJ3A6EcxYhG-symYmW7J8b_ws3S47CzQaA9KAgAK_QrTjwz8qGsPABa7uBQLs Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:50:39.679677 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:50:39.681045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f274d555f5c746cc885394c699b3d767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f274d555f5c746cc885394c699b3d767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:39.681045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:39.681045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:39.681045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:39.681045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:39.681045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:50:39.681045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:50:39.681045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 8773c88f88614a9d903f667305a217e0 Jul 14 11:50:39.681045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:39.681045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:50:39.681045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. Jul 14 11:50:39.681045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '72ebe862-edb8-480e-9c0d-02a791c8160b'} Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:39.681868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. Jul 14 11:50:39.684082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.693095 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a263a891-ab52-4f71-80da-2ca5ce841831 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Returning 404 to user: Instance 72ebe862-edb8-480e-9c0d-02a791c8160b could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:39.693095 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a263a891-ab52-4f71-80da-2ca5ce841831 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b" status: 404 len: 111 microversion: 2.1 time: 0.034379 Jul 14 11:50:39.693095 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 437/920] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:39 2022] GET /compute/v2.1/servers/72ebe862-edb8-480e-9c0d-02a791c8160b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:39.693415 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-fba7cf74-53cf-4574-8d0d-7e71e89c3a32 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:39.693725 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-fba7cf74-53cf-4574-8d0d-7e71e89c3a32 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:39.700010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fba7cf74-53cf-4574-8d0d-7e71e89c3a32 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:39.700660 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fba7cf74-53cf-4574-8d0d-7e71e89c3a32 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:39.701471 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fba7cf74-53cf-4574-8d0d-7e71e89c3a32 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:39.702070 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fba7cf74-53cf-4574-8d0d-7e71e89c3a32 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:39.879991 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-fba7cf74-53cf-4574-8d0d-7e71e89c3a32 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] HTTP exception thrown: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-fba7cf74-53cf-4574-8d0d-7e71e89c3a32 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Request method failure captured: Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: DELETE /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 HTTP/1.1 Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AGNrCXQELDmNK7QTgAsdlJtPBM_GXw3pFQ92I5FXg_Nl7xnN8erDQ0jD6cBgqZwNWgSGDIvH_OU-IJPWW0i2GmYKcnE8wD4a47a9DJeOO5JgDloTkiJ3A6EcxYhG-symYmW7J8b_ws3S47CzQaA9KAgAK_QrTjwz8qGsPABa7uBQLs Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:50:39.882407 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:50:39.884014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f274d555f5c746cc885394c699b3d767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f274d555f5c746cc885394c699b3d767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:39.884014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:39.884014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:39.884014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:39.884014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:39.884014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:50:39.884014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:50:39.884014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 8773c88f88614a9d903f667305a217e0 Jul 14 11:50:39.884014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:39.884014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:50:39.884014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. Jul 14 11:50:39.884014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': '3b863b39-54e7-4601-bb9b-d41e745f2e25'} Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:39.884898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. Jul 14 11:50:39.886388 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.889122 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-fba7cf74-53cf-4574-8d0d-7e71e89c3a32 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Returning 404 to user: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:39.890199 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-fba7cf74-53cf-4574-8d0d-7e71e89c3a32 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 404 len: 111 microversion: 2.1 time: 0.202713 Jul 14 11:50:39.890928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 484/921] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:50:39 2022] DELETE /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:39.900163 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-acbfb84e-71e9-4a18-aba8-fe3bfc35004f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:39.902873 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-acbfb84e-71e9-4a18-aba8-fe3bfc35004f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: 3b863b39-54e7-4601-bb9b-d41e745f2e25] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:39.907839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-acbfb84e-71e9-4a18-aba8-fe3bfc35004f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:39.908294 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-acbfb84e-71e9-4a18-aba8-fe3bfc35004f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:39.909075 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-acbfb84e-71e9-4a18-aba8-fe3bfc35004f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:39.909542 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-acbfb84e-71e9-4a18-aba8-fe3bfc35004f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:39.924330 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-acbfb84e-71e9-4a18-aba8-fe3bfc35004f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] HTTP exception thrown: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-acbfb84e-71e9-4a18-aba8-fe3bfc35004f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Request method failure captured: Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 HTTP/1.1 Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGNrCXQELDmNK7QTgAsdlJtPBM_GXw3pFQ92I5FXg_Nl7xnN8erDQ0jD6cBgqZwNWgSGDIvH_OU-IJPWW0i2GmYKcnE8wD4a47a9DJeOO5JgDloTkiJ3A6EcxYhG-symYmW7J8b_ws3S47CzQaA9KAgAK_QrTjwz8qGsPABa7uBQLs Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:50:39.925943 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:50:39.927258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f274d555f5c746cc885394c699b3d767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f274d555f5c746cc885394c699b3d767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:39.927258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:39.927258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:39.927258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:39.927258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:39.927258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:50:39.927258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:50:39.927258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 8773c88f88614a9d903f667305a217e0 Jul 14 11:50:39.927258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:39.927258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:50:39.927258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. Jul 14 11:50:39.927258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '3b863b39-54e7-4601-bb9b-d41e745f2e25'} Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:39.927989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. Jul 14 11:50:39.929234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:39.935930 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-acbfb84e-71e9-4a18-aba8-fe3bfc35004f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Returning 404 to user: Instance 3b863b39-54e7-4601-bb9b-d41e745f2e25 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:39.935930 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-acbfb84e-71e9-4a18-aba8-fe3bfc35004f tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25" status: 404 len: 111 microversion: 2.1 time: 0.032043 Jul 14 11:50:39.935930 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 438/922] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:39 2022] GET /compute/v2.1/servers/3b863b39-54e7-4601-bb9b-d41e745f2e25 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:50:40.182225 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d394ad31-fc01-407c-bdc6-992e53d83940 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:40.182746 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d394ad31-fc01-407c-bdc6-992e53d83940 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:40.188821 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d394ad31-fc01-407c-bdc6-992e53d83940 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:40.189311 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d394ad31-fc01-407c-bdc6-992e53d83940 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:40.190089 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d394ad31-fc01-407c-bdc6-992e53d83940 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:40.190529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d394ad31-fc01-407c-bdc6-992e53d83940 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:40.205192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-d394ad31-fc01-407c-bdc6-992e53d83940 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] HTTP exception thrown: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d394ad31-fc01-407c-bdc6-992e53d83940 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Request method failure captured: Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: DELETE /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 HTTP/1.1 Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AGIz-VVLj5Cn2FeK00spv5i4jycBYb48_psBZTc_hmV4y6eMDaZWost2EUEADSFG1X7rj_Tcbaj1sKJtsRnV5j0rnlTB6MsL2L3ilmuBAkJH4UHaAsls8Zsz4k6CRGrV3bT6szT_JYs4JSJlP56caFYRnZ_t9VH7-GDIQxW2qkXUJE Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 48a88ac7db8a481ca03508d315a0bc56 Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:50:40.207069 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:50:40.208664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:40.208664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:50:40.208664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 48a88ac7db8a481ca03508d315a0bc56 Jul 14 11:50:40.208664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:50:40.208664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-AttachVolumeTestJSON-1543342879-project Jul 14 11:50:40.208664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:50:40.208664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:50:40.208664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 246f07024efa444da74f2b898f426b46 Jul 14 11:50:40.208664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-AttachVolumeTestJSON-1543342879-project Jul 14 11:50:40.208664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:50:40.208664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. Jul 14 11:50:40.208664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': '4a9a7ce6-aede-493e-8e91-b35f4c51d954'} Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:40.209605 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. Jul 14 11:50:40.211066 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:40.212576 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d394ad31-fc01-407c-bdc6-992e53d83940 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Returning 404 to user: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:40.212576 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d394ad31-fc01-407c-bdc6-992e53d83940 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 404 len: 111 microversion: 2.1 time: 0.032642 Jul 14 11:50:40.212576 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 485/923] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:50:40 2022] DELETE /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:40.217910 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a16523ba-5d44-4fe0-9b38-254393c92a3f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:40.218045 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a16523ba-5d44-4fe0-9b38-254393c92a3f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 4a9a7ce6-aede-493e-8e91-b35f4c51d954] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:40.224926 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a16523ba-5d44-4fe0-9b38-254393c92a3f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:40.225406 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a16523ba-5d44-4fe0-9b38-254393c92a3f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:40.226385 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a16523ba-5d44-4fe0-9b38-254393c92a3f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:40.226976 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a16523ba-5d44-4fe0-9b38-254393c92a3f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:40.241340 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-a16523ba-5d44-4fe0-9b38-254393c92a3f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] HTTP exception thrown: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a16523ba-5d44-4fe0-9b38-254393c92a3f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Request method failure captured: Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 HTTP/1.1 Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGIz-VVLj5Cn2FeK00spv5i4jycBYb48_psBZTc_hmV4y6eMDaZWost2EUEADSFG1X7rj_Tcbaj1sKJtsRnV5j0rnlTB6MsL2L3ilmuBAkJH4UHaAsls8Zsz4k6CRGrV3bT6szT_JYs4JSJlP56caFYRnZ_t9VH7-GDIQxW2qkXUJE Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 48a88ac7db8a481ca03508d315a0bc56 Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:50:40.246830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:50:40.248517 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:40.248517 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:50:40.248517 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 48a88ac7db8a481ca03508d315a0bc56 Jul 14 11:50:40.248517 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:50:40.248517 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-AttachVolumeTestJSON-1543342879-project Jul 14 11:50:40.248517 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:50:40.248517 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:50:40.248517 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 246f07024efa444da74f2b898f426b46 Jul 14 11:50:40.248517 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-AttachVolumeTestJSON-1543342879-project Jul 14 11:50:40.248517 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:50:40.248517 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. Jul 14 11:50:40.248517 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '4a9a7ce6-aede-493e-8e91-b35f4c51d954'} Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:40.249431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. Jul 14 11:50:40.251052 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:40.252443 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a16523ba-5d44-4fe0-9b38-254393c92a3f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Returning 404 to user: Instance 4a9a7ce6-aede-493e-8e91-b35f4c51d954 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:40.252443 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a16523ba-5d44-4fe0-9b38-254393c92a3f tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954" status: 404 len: 111 microversion: 2.1 time: 0.031003 Jul 14 11:50:40.252443 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 439/924] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:40 2022] GET /compute/v2.1/servers/4a9a7ce6-aede-493e-8e91-b35f4c51d954 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:41.270485 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8d1fa477-df06-49e7-8579-c02b18ca56e5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:41.272371 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-8d1fa477-df06-49e7-8579-c02b18ca56e5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:41.278014 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8d1fa477-df06-49e7-8579-c02b18ca56e5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:41.278466 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8d1fa477-df06-49e7-8579-c02b18ca56e5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:41.279253 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8d1fa477-df06-49e7-8579-c02b18ca56e5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:41.279697 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8d1fa477-df06-49e7-8579-c02b18ca56e5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:41.295590 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-8d1fa477-df06-49e7-8579-c02b18ca56e5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] HTTP exception thrown: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8d1fa477-df06-49e7-8579-c02b18ca56e5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Request method failure captured: Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: DELETE /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df HTTP/1.1 Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AGNrCXQELDmNK7QTgAsdlJtPBM_GXw3pFQ92I5FXg_Nl7xnN8erDQ0jD6cBgqZwNWgSGDIvH_OU-IJPWW0i2GmYKcnE8wD4a47a9DJeOO5JgDloTkiJ3A6EcxYhG-symYmW7J8b_ws3S47CzQaA9KAgAK_QrTjwz8qGsPABa7uBQLs Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:50:41.297179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:50:41.299317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f274d555f5c746cc885394c699b3d767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f274d555f5c746cc885394c699b3d767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:41.299317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:41.299317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:41.299317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:41.299317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:41.299317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:50:41.299317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:50:41.299317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 8773c88f88614a9d903f667305a217e0 Jul 14 11:50:41.299317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:41.299317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:50:41.299317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. Jul 14 11:50:41.299317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': 'edc1d8c0-48e2-49bd-8807-bb041db6a9df'} Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:41.300341 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. Jul 14 11:50:41.301912 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.303465 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8d1fa477-df06-49e7-8579-c02b18ca56e5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Returning 404 to user: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:41.303465 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-8d1fa477-df06-49e7-8579-c02b18ca56e5 tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "DELETE /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 404 len: 111 microversion: 2.1 time: 0.033004 Jul 14 11:50:41.303465 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 486/925] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:50:41 2022] DELETE /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:41.308898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-0bd182da-700d-4c4e-b54e-44b916b7b5ce tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:41.309569 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-0bd182da-700d-4c4e-b54e-44b916b7b5ce tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] [instance: edc1d8c0-48e2-49bd-8807-bb041db6a9df] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:41.316029 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0bd182da-700d-4c4e-b54e-44b916b7b5ce tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:41.316469 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0bd182da-700d-4c4e-b54e-44b916b7b5ce tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:41.317254 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0bd182da-700d-4c4e-b54e-44b916b7b5ce tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:41.317689 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-0bd182da-700d-4c4e-b54e-44b916b7b5ce tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:41.331868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-0bd182da-700d-4c4e-b54e-44b916b7b5ce tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] HTTP exception thrown: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-0bd182da-700d-4c4e-b54e-44b916b7b5ce tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Request method failure captured: Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df HTTP/1.1 Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGNrCXQELDmNK7QTgAsdlJtPBM_GXw3pFQ92I5FXg_Nl7xnN8erDQ0jD6cBgqZwNWgSGDIvH_OU-IJPWW0i2GmYKcnE8wD4a47a9DJeOO5JgDloTkiJ3A6EcxYhG-symYmW7J8b_ws3S47CzQaA9KAgAK_QrTjwz8qGsPABa7uBQLs Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:50:41.333623 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:50:41.335271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f274d555f5c746cc885394c699b3d767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f274d555f5c746cc885394c699b3d767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f274d555f5c746cc885394c699b3d767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:41.335271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:41.335271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: f274d555f5c746cc885394c699b3d767 Jul 14 11:50:41.335271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1370490288 Jul 14 11:50:41.335271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:41.335271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:50:41.335271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:50:41.335271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 8773c88f88614a9d903f667305a217e0 Jul 14 11:50:41.335271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-AttachVolumeNegativeTest-1370490288-project Jul 14 11:50:41.335271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:50:41.335271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. Jul 14 11:50:41.335271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': 'edc1d8c0-48e2-49bd-8807-bb041db6a9df'} Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:41.336348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. Jul 14 11:50:41.337820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.339288 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-0bd182da-700d-4c4e-b54e-44b916b7b5ce tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] Returning 404 to user: Instance edc1d8c0-48e2-49bd-8807-bb041db6a9df could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:41.339288 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-0bd182da-700d-4c4e-b54e-44b916b7b5ce tempest-AttachVolumeNegativeTest-1370490288 tempest-AttachVolumeNegativeTest-1370490288-project] 10.222.0.40 "GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df" status: 404 len: 111 microversion: 2.1 time: 0.030231 Jul 14 11:50:41.339288 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 440/926] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:41 2022] GET /compute/v2.1/servers/edc1d8c0-48e2-49bd-8807-bb041db6a9df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:41.662104 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-01b2db81-4ea8-49ba-ac3a-34c46e4189d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:41.662104 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-01b2db81-4ea8-49ba-ac3a-34c46e4189d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:41.665744 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-01b2db81-4ea8-49ba-ac3a-34c46e4189d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:41.666520 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-01b2db81-4ea8-49ba-ac3a-34c46e4189d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:41.667457 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-01b2db81-4ea8-49ba-ac3a-34c46e4189d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:41.668050 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-01b2db81-4ea8-49ba-ac3a-34c46e4189d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:41.684907 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-01b2db81-4ea8-49ba-ac3a-34c46e4189d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] HTTP exception thrown: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-01b2db81-4ea8-49ba-ac3a-34c46e4189d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Request method failure captured: Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: DELETE /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 HTTP/1.1 Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AGIz-VVLj5Cn2FeK00spv5i4jycBYb48_psBZTc_hmV4y6eMDaZWost2EUEADSFG1X7rj_Tcbaj1sKJtsRnV5j0rnlTB6MsL2L3ilmuBAkJH4UHaAsls8Zsz4k6CRGrV3bT6szT_JYs4JSJlP56caFYRnZ_t9VH7-GDIQxW2qkXUJE Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 48a88ac7db8a481ca03508d315a0bc56 Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:50:41.687312 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:50:41.689087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:41.689087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:50:41.689087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 48a88ac7db8a481ca03508d315a0bc56 Jul 14 11:50:41.689087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:50:41.689087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-AttachVolumeTestJSON-1543342879-project Jul 14 11:50:41.689087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:50:41.689087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:50:41.689087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 246f07024efa444da74f2b898f426b46 Jul 14 11:50:41.689087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-AttachVolumeTestJSON-1543342879-project Jul 14 11:50:41.689087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:50:41.689087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. Jul 14 11:50:41.689087 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': '36228e4a-c9d6-4e57-81fe-e8a49d221573'} Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:41.690010 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. Jul 14 11:50:41.691467 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.692974 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-01b2db81-4ea8-49ba-ac3a-34c46e4189d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Returning 404 to user: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:41.692974 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-01b2db81-4ea8-49ba-ac3a-34c46e4189d4 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "DELETE /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 404 len: 111 microversion: 2.1 time: 0.036491 Jul 14 11:50:41.692974 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 487/927] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:50:41 2022] DELETE /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:41.700674 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-140145c7-12f3-4931-b636-81c3b3f99c67 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:41.701531 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-140145c7-12f3-4931-b636-81c3b3f99c67 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] [instance: 36228e4a-c9d6-4e57-81fe-e8a49d221573] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:50:41.711019 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-140145c7-12f3-4931-b636-81c3b3f99c67 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:41.711795 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-140145c7-12f3-4931-b636-81c3b3f99c67 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:41.713373 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-140145c7-12f3-4931-b636-81c3b3f99c67 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:50:41.714023 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-140145c7-12f3-4931-b636-81c3b3f99c67 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:50:41.728966 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-140145c7-12f3-4931-b636-81c3b3f99c67 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] HTTP exception thrown: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-140145c7-12f3-4931-b636-81c3b3f99c67 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Request method failure captured: Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 HTTP/1.1 Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGIz-VVLj5Cn2FeK00spv5i4jycBYb48_psBZTc_hmV4y6eMDaZWost2EUEADSFG1X7rj_Tcbaj1sKJtsRnV5j0rnlTB6MsL2L3ilmuBAkJH4UHaAsls8Zsz4k6CRGrV3bT6szT_JYs4JSJlP56caFYRnZ_t9VH7-GDIQxW2qkXUJE Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 48a88ac7db8a481ca03508d315a0bc56 Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:50:41.730736 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:50:41.732314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/48a88ac7db8a481ca03508d315a0bc56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:41.732314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:50:41.732314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 48a88ac7db8a481ca03508d315a0bc56 Jul 14 11:50:41.732314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1543342879 Jul 14 11:50:41.732314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-AttachVolumeTestJSON-1543342879-project Jul 14 11:50:41.732314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:50:41.732314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:50:41.732314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 246f07024efa444da74f2b898f426b46 Jul 14 11:50:41.732314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-AttachVolumeTestJSON-1543342879-project Jul 14 11:50:41.732314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:50:41.732314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. Jul 14 11:50:41.732314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '36228e4a-c9d6-4e57-81fe-e8a49d221573'} Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:41.733142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. Jul 14 11:50:41.734485 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:41.735876 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-140145c7-12f3-4931-b636-81c3b3f99c67 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] Returning 404 to user: Instance 36228e4a-c9d6-4e57-81fe-e8a49d221573 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:41.735876 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-140145c7-12f3-4931-b636-81c3b3f99c67 tempest-AttachVolumeTestJSON-1543342879 tempest-AttachVolumeTestJSON-1543342879-project] 10.222.0.40 "GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573" status: 404 len: 111 microversion: 2.1 time: 0.036482 Jul 14 11:50:41.735876 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 441/928] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:50:41 2022] GET /compute/v2.1/servers/36228e4a-c9d6-4e57-81fe-e8a49d221573 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:49.714669 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b2387632-3a32-456f-b43a-4df31bf6eb91 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Action: 'create', calling method: .version_select at 0x7f1adf541670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1202157720"}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:50.526637 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b2387632-3a32-456f-b43a-4df31bf6eb91 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.259633 Jul 14 11:50:50.527678 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 488/929] 10.222.0.40 () {60 vars in 1154 bytes} [Thu Jul 14 11:50:49 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1261 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 11:50:50.538865 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d46d3f95-185b-49c3-a368-e7287fbf871c tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf4895e0>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:50.591720 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d46d3f95-185b-49c3-a368-e7287fbf871c tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878" status: 200 len: 345 microversion: 2.1 time: 0.056576 Jul 14 11:50:50.593190 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 442/930] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 11:50:50 2022] GET /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:51.611428 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-24812f35-e2d0-40d2-8c5f-8fa9e58af2ab tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf5ec4c0>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:51.663186 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-24812f35-e2d0-40d2-8c5f-8fa9e58af2ab tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878" status: 200 len: 346 microversion: 2.1 time: 0.063213 Jul 14 11:50:51.663743 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 489/931] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 11:50:51 2022] GET /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878 => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:51.680701 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-545488e8-e31b-47e4-aa90-7b95515d005d tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Action: 'create', calling method: .version_select at 0x7f1adf4b61f0>, body: {"snapshot": {"volume_id": "8a5302df-30a6-4d70-93cc-a680d480b878", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1821000792"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:50:51.706847 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:51.719489 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=23 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:52.297823 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-545488e8-e31b-47e4-aa90-7b95515d005d tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.620907 Jul 14 11:50:52.298706 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 443/932] 10.222.0.40 () {60 vars in 1161 bytes} [Thu Jul 14 11:50:51 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:50:52.308965 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3de80801-3738-41e9-9536-ef2647e66a4e tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf56b550>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:52.326142 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:52.326142 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=74 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:50:52.347740 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3de80801-3738-41e9-9536-ef2647e66a4e tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2" status: 200 len: 287 microversion: 2.1 time: 0.042792 Jul 14 11:50:52.348333 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 490/933] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 11:50:52 2022] GET /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:52.357951 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5b0ed3b4-e533-489b-b77f-9c0a673b008a tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf658160>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:52.404784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5b0ed3b4-e533-489b-b77f-9c0a673b008a tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.050132 Jul 14 11:50:52.405963 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 444/934] 10.222.0.40 () {58 vars in 1139 bytes} [Thu Jul 14 11:50:52 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:52.422597 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c945ddbf-c1b6-4e8d-82a5-3a282ab287ae tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf541670>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:52.461578 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c945ddbf-c1b6-4e8d-82a5-3a282ab287ae tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2" status: 200 len: 287 microversion: 2.1 time: 0.048985 Jul 14 11:50:52.462197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 491/935] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 11:50:52 2022] GET /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:50:53.477711 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-008303aa-b1ee-4fe7-bcb3-c56f4798b032 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf5089d0>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:53.525709 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-008303aa-b1ee-4fe7-bcb3-c56f4798b032 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2" status: 200 len: 287 microversion: 2.1 time: 0.053619 Jul 14 11:50:53.527893 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 445/936] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 11:50:53 2022] GET /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:54.539534 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-cc7beb7c-15e6-461d-92fc-a41a625c4916 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf5ec550>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:54.571223 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-cc7beb7c-15e6-461d-92fc-a41a625c4916 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2" status: 200 len: 287 microversion: 2.1 time: 0.036520 Jul 14 11:50:54.571875 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 492/937] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 11:50:54 2022] GET /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:50:55.587004 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-91246dad-464f-4f3e-9a75-01502e17e333 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf539700>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:55.619974 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-91246dad-464f-4f3e-9a75-01502e17e333 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2" status: 200 len: 288 microversion: 2.1 time: 0.039677 Jul 14 11:50:55.620551 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 446/938] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 11:50:55 2022] GET /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2 => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:55.631908 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-96c8139d-5617-4b98-bcb5-da3ba2e83017 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf56b8b0>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:55.815582 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-96c8139d-5617-4b98-bcb5-da3ba2e83017 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2" status: 202 len: 0 microversion: 2.1 time: 0.186802 Jul 14 11:50:55.815582 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 493/939] 10.222.0.40 () {58 vars in 1253 bytes} [Thu Jul 14 11:50:55 2022] DELETE /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:50:55.823363 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-2d974af3-7fcc-455d-a688-abf419a43ff1 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf6588b0>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:55.853546 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-2d974af3-7fcc-455d-a688-abf419a43ff1 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2" status: 200 len: 287 microversion: 2.1 time: 0.033953 Jul 14 11:50:55.854120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 447/940] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 11:50:55 2022] GET /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:56.867229 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-828bfd02-1f5f-4ef0-a9ed-72ae1d6eda96 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf5ecb80>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:56.896050 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-828bfd02-1f5f-4ef0-a9ed-72ae1d6eda96 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] HTTP exception thrown: Snapshot c5656119-2a82-498d-85d8-841d0a7300e2 could not be found. Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-828bfd02-1f5f-4ef0-a9ed-72ae1d6eda96 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Request method failure captured: Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: GET /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2 HTTP/1.1 Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AMZOYpNghTiDx0ADIRr1J2N2ZTJkRgsEnKwBbXGrhyV5Fox47bVLrbZJ0QuNA40RGm1-9Q0vHTzjivMOFZEkX1oiu34Nn2CXGucxbM1iNG8b6Rfhks96Yodrv21pidKs7qW0nTMIH4uRBDaMCQMUJzHMgG5m5v-U6Ekw9OZ8bVnWWI Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 470ff30a8d044d2895f3288850efe24b Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1626835228 Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:50:56.904350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:50:56.906147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/470ff30a8d044d2895f3288850efe24b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_470ff30a8d044d2895f3288850efe24b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/470ff30a8d044d2895f3288850efe24b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/470ff30a8d044d2895f3288850efe24b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:56.906147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1626835228 Jul 14 11:50:56.906147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 470ff30a8d044d2895f3288850efe24b Jul 14 11:50:56.906147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1626835228 Jul 14 11:50:56.906147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-VolumesSnapshotsTestJSON-1626835228-project Jul 14 11:50:56.906147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:50:56.906147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:50:56.906147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 903e0909e33a4c11add83681440180d2 Jul 14 11:50:56.906147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1626835228-project Jul 14 11:50:56.906147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: Jul 14 11:50:56.906147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Snapshot c5656119-2a82-498d-85d8-841d0a7300e2 could not be found. Jul 14 11:50:56.906147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': 'c5656119-2a82-498d-85d8-841d0a7300e2'} Jul 14 11:50:56.906147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c5656119-2a82-498d-85d8-841d0a7300e2 could not be found. (HTTP 404) (Request-ID: req-407b782d-8853-4f84-8e2c-358fdd0f538f) Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:56.907250 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:50:56.908721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c5656119-2a82-498d-85d8-841d0a7300e2 could not be found. Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 11:50:56.911008 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:56.912552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c5656119-2a82-498d-85d8-841d0a7300e2 could not be found. Jul 14 11:50:56.912552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:56.912552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:56.912552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:56.912552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:56.912552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:56.912552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:56.912552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:56.912552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:56.912552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c5656119-2a82-498d-85d8-841d0a7300e2 could not be found. Jul 14 11:50:56.912552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:56.912552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-828bfd02-1f5f-4ef0-a9ed-72ae1d6eda96 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Returning 404 to user: Snapshot c5656119-2a82-498d-85d8-841d0a7300e2 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:56.912552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-828bfd02-1f5f-4ef0-a9ed-72ae1d6eda96 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2" status: 404 len: 111 microversion: 2.1 time: 0.042928 Jul 14 11:50:56.913649 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 494/941] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 11:50:56 2022] GET /compute/v2.1/os-snapshots/c5656119-2a82-498d-85d8-841d0a7300e2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:56.915490 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e55e8ede-2b29-4ac9-96fe-6940d0e303e0 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf511f70>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:57.193125 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e55e8ede-2b29-4ac9-96fe-6940d0e303e0 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878" status: 202 len: 0 microversion: 2.1 time: 0.282104 Jul 14 11:50:57.197914 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 448/942] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 11:50:56 2022] DELETE /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:50:57.202094 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-bc0bb559-fad9-4af6-b149-37385d49d18b tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf5efca0>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:57.249382 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-bc0bb559-fad9-4af6-b149-37385d49d18b tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878" status: 200 len: 345 microversion: 2.1 time: 0.051242 Jul 14 11:50:57.249949 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 495/943] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 11:50:57 2022] GET /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:50:58.265106 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-314d9912-5bdd-4d75-aa25-35eeb7a0dfc4 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf4b6ca0>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:58.301339 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-314d9912-5bdd-4d75-aa25-35eeb7a0dfc4 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] HTTP exception thrown: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-314d9912-5bdd-4d75-aa25-35eeb7a0dfc4 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Request method failure captured: Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878 HTTP/1.1 Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AMZOYpNghTiDx0ADIRr1J2N2ZTJkRgsEnKwBbXGrhyV5Fox47bVLrbZJ0QuNA40RGm1-9Q0vHTzjivMOFZEkX1oiu34Nn2CXGucxbM1iNG8b6Rfhks96Yodrv21pidKs7qW0nTMIH4uRBDaMCQMUJzHMgG5m5v-U6Ekw9OZ8bVnWWI Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 470ff30a8d044d2895f3288850efe24b Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1626835228 Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:50:58.305948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:50:58.308003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/470ff30a8d044d2895f3288850efe24b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_470ff30a8d044d2895f3288850efe24b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/470ff30a8d044d2895f3288850efe24b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/470ff30a8d044d2895f3288850efe24b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:58.308003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1626835228 Jul 14 11:50:58.308003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 470ff30a8d044d2895f3288850efe24b Jul 14 11:50:58.308003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1626835228 Jul 14 11:50:58.308003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-VolumesSnapshotsTestJSON-1626835228-project Jul 14 11:50:58.308003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:50:58.308003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:50:58.308003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 903e0909e33a4c11add83681440180d2 Jul 14 11:50:58.308003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1626835228-project Jul 14 11:50:58.308003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: Jul 14 11:50:58.308003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. Jul 14 11:50:58.308003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '8a5302df-30a6-4d70-93cc-a680d480b878'} Jul 14 11:50:58.308003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. (HTTP 404) (Request-ID: req-a4cb790b-2a8b-402f-a7ea-395cf1292f07) Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:58.309105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:50:58.311235 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 11:50:58.312412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:58.313601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. Jul 14 11:50:58.313601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.313601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:58.313601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.313601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:58.313601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:58.313601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:58.313601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:58.313601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:58.313601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. Jul 14 11:50:58.313601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.313601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-314d9912-5bdd-4d75-aa25-35eeb7a0dfc4 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Returning 404 to user: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:58.313601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-314d9912-5bdd-4d75-aa25-35eeb7a0dfc4 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878" status: 404 len: 109 microversion: 2.1 time: 0.049264 Jul 14 11:50:58.313601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 449/944] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 11:50:58 2022] GET /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:58.322830 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c92ce288-d92f-4d5a-9c87-40f835383da2 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf5d9ee0>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:58.350954 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-c92ce288-d92f-4d5a-9c87-40f835383da2 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] HTTP exception thrown: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c92ce288-d92f-4d5a-9c87-40f835383da2 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Request method failure captured: Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: DELETE /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878 HTTP/1.1 Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AMZOYpNghTiDx0ADIRr1J2N2ZTJkRgsEnKwBbXGrhyV5Fox47bVLrbZJ0QuNA40RGm1-9Q0vHTzjivMOFZEkX1oiu34Nn2CXGucxbM1iNG8b6Rfhks96Yodrv21pidKs7qW0nTMIH4uRBDaMCQMUJzHMgG5m5v-U6Ekw9OZ8bVnWWI Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 470ff30a8d044d2895f3288850efe24b Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1626835228 Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:50:58.353756 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:50:58.355377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/470ff30a8d044d2895f3288850efe24b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_470ff30a8d044d2895f3288850efe24b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/470ff30a8d044d2895f3288850efe24b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/470ff30a8d044d2895f3288850efe24b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:58.355377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1626835228 Jul 14 11:50:58.355377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 470ff30a8d044d2895f3288850efe24b Jul 14 11:50:58.355377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1626835228 Jul 14 11:50:58.355377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-VolumesSnapshotsTestJSON-1626835228-project Jul 14 11:50:58.355377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:50:58.355377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:50:58.355377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 903e0909e33a4c11add83681440180d2 Jul 14 11:50:58.355377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1626835228-project Jul 14 11:50:58.355377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: Jul 14 11:50:58.355377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. Jul 14 11:50:58.355377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': '8a5302df-30a6-4d70-93cc-a680d480b878'} Jul 14 11:50:58.355377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. (HTTP 404) (Request-ID: req-2a32dc1f-adb5-48ec-892e-8d1e8bff4b01) Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:58.356665 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:50:58.358097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 11:50:58.359958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:58.361661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. Jul 14 11:50:58.361661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.361661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:58.361661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.361661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:58.361661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:58.361661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:58.361661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:58.361661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:58.361661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. Jul 14 11:50:58.361661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.361661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c92ce288-d92f-4d5a-9c87-40f835383da2 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Returning 404 to user: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:58.361661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c92ce288-d92f-4d5a-9c87-40f835383da2 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878" status: 404 len: 109 microversion: 2.1 time: 0.038046 Jul 14 11:50:58.361661 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 496/945] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 11:50:58 2022] DELETE /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:50:58.366319 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6a28e027-43bd-4596-8b35-271e3804fba6 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Calling method '.version_select at 0x7f1adf6cc0d0>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:50:58.395091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-6a28e027-43bd-4596-8b35-271e3804fba6 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] HTTP exception thrown: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6a28e027-43bd-4596-8b35-271e3804fba6 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Request method failure captured: Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878 HTTP/1.1 Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AMZOYpNghTiDx0ADIRr1J2N2ZTJkRgsEnKwBbXGrhyV5Fox47bVLrbZJ0QuNA40RGm1-9Q0vHTzjivMOFZEkX1oiu34Nn2CXGucxbM1iNG8b6Rfhks96Yodrv21pidKs7qW0nTMIH4uRBDaMCQMUJzHMgG5m5v-U6Ekw9OZ8bVnWWI Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 470ff30a8d044d2895f3288850efe24b Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1626835228 Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:50:58.398742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:50:58.400576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/470ff30a8d044d2895f3288850efe24b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_470ff30a8d044d2895f3288850efe24b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/470ff30a8d044d2895f3288850efe24b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/470ff30a8d044d2895f3288850efe24b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:50:58.400576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1626835228 Jul 14 11:50:58.400576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 470ff30a8d044d2895f3288850efe24b Jul 14 11:50:58.400576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1626835228 Jul 14 11:50:58.400576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-VolumesSnapshotsTestJSON-1626835228-project Jul 14 11:50:58.400576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:50:58.400576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:50:58.400576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 903e0909e33a4c11add83681440180d2 Jul 14 11:50:58.400576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1626835228-project Jul 14 11:50:58.400576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: Jul 14 11:50:58.400576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. Jul 14 11:50:58.400576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '8a5302df-30a6-4d70-93cc-a680d480b878'} Jul 14 11:50:58.400576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. (HTTP 404) (Request-ID: req-5543449a-337b-4485-a9a6-f3157d1bd15d) Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:58.401561 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:50:58.402886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 11:50:58.404323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:50:58.406145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. Jul 14 11:50:58.406145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.406145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:50:58.406145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.406145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:50:58.406145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:50:58.406145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:50:58.406145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:50:58.406145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:50:58.406145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. Jul 14 11:50:58.406145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:50:58.406145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6a28e027-43bd-4596-8b35-271e3804fba6 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] Returning 404 to user: Volume 8a5302df-30a6-4d70-93cc-a680d480b878 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:50:58.406145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6a28e027-43bd-4596-8b35-271e3804fba6 tempest-VolumesSnapshotsTestJSON-1626835228 tempest-VolumesSnapshotsTestJSON-1626835228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878" status: 404 len: 109 microversion: 2.1 time: 0.036290 Jul 14 11:50:58.406145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 450/946] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 11:50:58 2022] GET /compute/v2.1/os-volumes/8a5302df-30a6-4d70-93cc-a680d480b878 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:51:01.489033 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3997c9d1-1027-47d3-b9e8-6d26da55ff4e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:01.490715 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3997c9d1-1027-47d3-b9e8-6d26da55ff4e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:01.497353 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3997c9d1-1027-47d3-b9e8-6d26da55ff4e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:01.497813 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3997c9d1-1027-47d3-b9e8-6d26da55ff4e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:01.498618 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3997c9d1-1027-47d3-b9e8-6d26da55ff4e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:01.499061 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3997c9d1-1027-47d3-b9e8-6d26da55ff4e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:01.531381 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3997c9d1-1027-47d3-b9e8-6d26da55ff4e tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047179 Jul 14 11:51:01.532565 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 497/947] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 11:51:01 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:51:01.597278 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a39a6a02-dfd2-4ecb-b259-2f33a4ab8a19 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:01.597854 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a39a6a02-dfd2-4ecb-b259-2f33a4ab8a19 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:01.604646 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a39a6a02-dfd2-4ecb-b259-2f33a4ab8a19 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:01.605095 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a39a6a02-dfd2-4ecb-b259-2f33a4ab8a19 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:01.605905 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a39a6a02-dfd2-4ecb-b259-2f33a4ab8a19 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:01.606386 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a39a6a02-dfd2-4ecb-b259-2f33a4ab8a19 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:01.631157 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a39a6a02-dfd2-4ecb-b259-2f33a4ab8a19 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Going to try to terminate instance {{(pid=124946) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:51:01.933639 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a39a6a02-dfd2-4ecb-b259-2f33a4ab8a19 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 204 len: 0 microversion: 2.20 time: 0.340521 Jul 14 11:51:01.934504 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 451/948] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jul 14 11:51:01 2022] DELETE /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 11:51:01.943425 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8c72a416-7227-43ca-afd9-439571af6433 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:01.944252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-8c72a416-7227-43ca-afd9-439571af6433 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:01.950394 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8c72a416-7227-43ca-afd9-439571af6433 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:01.950841 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8c72a416-7227-43ca-afd9-439571af6433 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:01.951799 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8c72a416-7227-43ca-afd9-439571af6433 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:01.952231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8c72a416-7227-43ca-afd9-439571af6433 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:02.107752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-8c72a416-7227-43ca-afd9-439571af6433 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:02.114475 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-8c72a416-7227-43ca-afd9-439571af6433 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:02.115998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-8c72a416-7227-43ca-afd9-439571af6433 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:02.117175 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-8c72a416-7227-43ca-afd9-439571af6433 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.178503 Jul 14 11:51:02.117747 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 498/949] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:51:01 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:51:02.866255 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5b66befa-bc5e-4884-8195-c465bec76463 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:02.867034 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5b66befa-bc5e-4884-8195-c465bec76463 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:02.880411 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5b66befa-bc5e-4884-8195-c465bec76463 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:02.883509 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5b66befa-bc5e-4884-8195-c465bec76463 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:02.883662 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-29458c88-7bfe-4eb3-a41e-fe6b148b3da8 req-9f01d88e-1c5a-43e3-8f09-f9d6e42e81cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee797cbe-7b7e-4e87-9da7-0c628ae3ede1", "tag": "df04a441-a4c9-485f-845a-68acb74d2d4e"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:51:02.884144 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5b66befa-bc5e-4884-8195-c465bec76463 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:02.884144 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5b66befa-bc5e-4884-8195-c465bec76463 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:02.904214 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-29458c88-7bfe-4eb3-a41e-fe6b148b3da8 req-9f01d88e-1c5a-43e3-8f09-f9d6e42e81cd service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:02.904670 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-29458c88-7bfe-4eb3-a41e-fe6b148b3da8 req-9f01d88e-1c5a-43e3-8f09-f9d6e42e81cd service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:02.918717 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5b66befa-bc5e-4884-8195-c465bec76463 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Going to try to terminate instance {{(pid=124946) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:51:02.928299 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-29458c88-7bfe-4eb3-a41e-fe6b148b3da8 req-9f01d88e-1c5a-43e3-8f09-f9d6e42e81cd service nova] Creating event network-changed:df04a441-a4c9-485f-845a-68acb74d2d4e for instance ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 on hv-cinder-84980 Jul 14 11:51:02.944317 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-29458c88-7bfe-4eb3-a41e-fe6b148b3da8 req-9f01d88e-1c5a-43e3-8f09-f9d6e42e81cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067535 Jul 14 11:51:02.945769 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 499/950] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:51:03.137277 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-35b65d46-7ba9-4528-ac1c-9d966bd58aef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:03.137997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-35b65d46-7ba9-4528-ac1c-9d966bd58aef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:03.145151 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-35b65d46-7ba9-4528-ac1c-9d966bd58aef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:03.145629 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-35b65d46-7ba9-4528-ac1c-9d966bd58aef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:03.146702 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-35b65d46-7ba9-4528-ac1c-9d966bd58aef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:03.147357 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-35b65d46-7ba9-4528-ac1c-9d966bd58aef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:03.311778 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5b66befa-bc5e-4884-8195-c465bec76463 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 204 len: 0 microversion: 2.1 time: 0.450437 Jul 14 11:51:03.313525 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 452/951] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:51:02 2022] DELETE /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:51:03.323837 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5b94d591-c14e-4eb4-81fc-2e67655e4cad tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:03.324553 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5b94d591-c14e-4eb4-81fc-2e67655e4cad tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:03.344683 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5b94d591-c14e-4eb4-81fc-2e67655e4cad tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:03.350437 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5b94d591-c14e-4eb4-81fc-2e67655e4cad tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:03.351683 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5b94d591-c14e-4eb4-81fc-2e67655e4cad tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:03.353900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5b94d591-c14e-4eb4-81fc-2e67655e4cad tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:03.368024 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-35b65d46-7ba9-4528-ac1c-9d966bd58aef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:03.378000 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-35b65d46-7ba9-4528-ac1c-9d966bd58aef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:03.380152 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-35b65d46-7ba9-4528-ac1c-9d966bd58aef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:03.381617 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-35b65d46-7ba9-4528-ac1c-9d966bd58aef tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.249501 Jul 14 11:51:03.390669 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 500/952] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:51:03 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:51:03.526194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5b94d591-c14e-4eb4-81fc-2e67655e4cad tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:03.537700 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5b94d591-c14e-4eb4-81fc-2e67655e4cad tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.217603 Jul 14 11:51:03.545105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 453/953] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:51:03 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:51:04.401534 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-230f9e1a-cca1-4479-90e2-6ff579701097 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:04.407531 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-230f9e1a-cca1-4479-90e2-6ff579701097 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:04.412146 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-230f9e1a-cca1-4479-90e2-6ff579701097 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:04.412339 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-230f9e1a-cca1-4479-90e2-6ff579701097 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:04.426406 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-230f9e1a-cca1-4479-90e2-6ff579701097 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:04.430456 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-230f9e1a-cca1-4479-90e2-6ff579701097 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:04.554237 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-974162c2-d477-4608-a9d8-1ca28259c0a4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:04.554855 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-974162c2-d477-4608-a9d8-1ca28259c0a4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:04.562889 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-974162c2-d477-4608-a9d8-1ca28259c0a4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:04.563772 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-974162c2-d477-4608-a9d8-1ca28259c0a4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:04.565369 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-974162c2-d477-4608-a9d8-1ca28259c0a4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:04.566050 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-974162c2-d477-4608-a9d8-1ca28259c0a4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:04.741758 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-974162c2-d477-4608-a9d8-1ca28259c0a4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:04.750073 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-974162c2-d477-4608-a9d8-1ca28259c0a4 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1570 microversion: 2.1 time: 0.199912 Jul 14 11:51:04.750948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 454/954] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:51:04 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1570 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:51:04.993281 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-230f9e1a-cca1-4479-90e2-6ff579701097 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:05.005493 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-230f9e1a-cca1-4479-90e2-6ff579701097 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:05.009725 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-230f9e1a-cca1-4479-90e2-6ff579701097 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:05.011214 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-230f9e1a-cca1-4479-90e2-6ff579701097 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1724 microversion: 2.20 time: 0.615432 Jul 14 11:51:05.025598 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 501/955] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:51:04 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1724 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:51:05.769962 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-f24267cb-103a-4808-9bf6-0889298800fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:05.770593 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-f24267cb-103a-4808-9bf6-0889298800fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:05.778459 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f24267cb-103a-4808-9bf6-0889298800fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:05.778917 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f24267cb-103a-4808-9bf6-0889298800fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:05.779688 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f24267cb-103a-4808-9bf6-0889298800fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:05.780126 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f24267cb-103a-4808-9bf6-0889298800fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:05.878945 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f24267cb-103a-4808-9bf6-0889298800fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:05.886632 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-f24267cb-103a-4808-9bf6-0889298800fc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1383 microversion: 2.1 time: 0.121467 Jul 14 11:51:05.887202 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 455/956] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:51:05 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1383 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:51:05.974481 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-a0ff1860-0978-4025-aee1-a8718589e666 req-c2dcca5c-d5ab-4557-94a9-fbfee92f1893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee797cbe-7b7e-4e87-9da7-0c628ae3ede1", "name": "network-vif-deleted", "tag": "df04a441-a4c9-485f-845a-68acb74d2d4e"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:51:05.983243 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-a0ff1860-0978-4025-aee1-a8718589e666 req-c2dcca5c-d5ab-4557-94a9-fbfee92f1893 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:05.983684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-a0ff1860-0978-4025-aee1-a8718589e666 req-c2dcca5c-d5ab-4557-94a9-fbfee92f1893 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:05.995712 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-a0ff1860-0978-4025-aee1-a8718589e666 req-c2dcca5c-d5ab-4557-94a9-fbfee92f1893 service nova] Creating event network-vif-deleted:df04a441-a4c9-485f-845a-68acb74d2d4e for instance ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 on hv-cinder-84980 Jul 14 11:51:06.003926 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-a0ff1860-0978-4025-aee1-a8718589e666 req-c2dcca5c-d5ab-4557-94a9-fbfee92f1893 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032810 Jul 14 11:51:06.005213 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 502/957] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:51:06.032329 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5efbd747-7a51-42fd-96e4-5a92ff2a6de6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:06.032944 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5efbd747-7a51-42fd-96e4-5a92ff2a6de6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:06.040660 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5efbd747-7a51-42fd-96e4-5a92ff2a6de6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:06.040660 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5efbd747-7a51-42fd-96e4-5a92ff2a6de6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:06.041574 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5efbd747-7a51-42fd-96e4-5a92ff2a6de6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:06.042010 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5efbd747-7a51-42fd-96e4-5a92ff2a6de6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:06.139230 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-673c9392-3122-4c32-9f19-30e397b030a7 req-1b7e8d92-18b0-4888-bf0f-d985643d37df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08c817f-cc75-4c71-8645-51a7a1938404", "name": "network-vif-deleted", "tag": "5c8aa46b-5efe-4ab3-b31e-03775de21303"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:51:06.149120 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-673c9392-3122-4c32-9f19-30e397b030a7 req-1b7e8d92-18b0-4888-bf0f-d985643d37df service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:06.149586 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-673c9392-3122-4c32-9f19-30e397b030a7 req-1b7e8d92-18b0-4888-bf0f-d985643d37df service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:06.162145 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-673c9392-3122-4c32-9f19-30e397b030a7 req-1b7e8d92-18b0-4888-bf0f-d985643d37df service nova] Creating event network-vif-deleted:5c8aa46b-5efe-4ab3-b31e-03775de21303 for instance e08c817f-cc75-4c71-8645-51a7a1938404 on hv-cinder-84980 Jul 14 11:51:06.167703 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-673c9392-3122-4c32-9f19-30e397b030a7 req-1b7e8d92-18b0-4888-bf0f-d985643d37df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032540 Jul 14 11:51:06.172464 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 503/958] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:51:06.268854 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5efbd747-7a51-42fd-96e4-5a92ff2a6de6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:06.286214 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5efbd747-7a51-42fd-96e4-5a92ff2a6de6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:06.286214 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5efbd747-7a51-42fd-96e4-5a92ff2a6de6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '899cbac79d874b308b500651bb40b2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81777430895b432999f69033667e59f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:06.286214 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5efbd747-7a51-42fd-96e4-5a92ff2a6de6 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 200 len: 1656 microversion: 2.20 time: 0.254878 Jul 14 11:51:06.286944 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 456/959] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:51:06 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 1656 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:51:06.906254 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-713ff61a-070f-441d-9d72-09c5f91029f0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:06.907027 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-713ff61a-070f-441d-9d72-09c5f91029f0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:06.914806 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-713ff61a-070f-441d-9d72-09c5f91029f0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:06.915573 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-713ff61a-070f-441d-9d72-09c5f91029f0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:06.916547 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-713ff61a-070f-441d-9d72-09c5f91029f0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:06.917243 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-713ff61a-070f-441d-9d72-09c5f91029f0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:07.026633 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-713ff61a-070f-441d-9d72-09c5f91029f0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd352cf5c00ae450c9a7ca4dcc68a87db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23768669a74586a221c14ebaa8ee26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:51:07.039441 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-713ff61a-070f-441d-9d72-09c5f91029f0 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 200 len: 1219 microversion: 2.1 time: 0.137807 Jul 14 11:51:07.040148 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 504/960] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:51:06 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:51:07.304881 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3efed90c-db56-41cd-a0b9-faf70622b3f7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:07.305639 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3efed90c-db56-41cd-a0b9-faf70622b3f7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:07.316038 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3efed90c-db56-41cd-a0b9-faf70622b3f7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:07.318027 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3efed90c-db56-41cd-a0b9-faf70622b3f7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:07.322764 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3efed90c-db56-41cd-a0b9-faf70622b3f7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:07.323870 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3efed90c-db56-41cd-a0b9-faf70622b3f7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:07.341572 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-3efed90c-db56-41cd-a0b9-faf70622b3f7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] HTTP exception thrown: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3efed90c-db56-41cd-a0b9-faf70622b3f7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Request method failure captured: Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 HTTP/1.1 Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGMSn7vQegOUWmSGgr_EOwUboZjvtuC0z2ZIkI74vrcApT1meUEh0Vm2NexV6jNnwhFR25jj32KjYlT0TcKdhtN8PZJAKqHjUiNEGHQfuvToxMYoOH28RYTOr5HgE_PdImIc_-bsBaF1kyOpLe_k8NBL4OqUd_t3VZ6Yz_FbzY6BNI Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 81777430895b432999f69033667e59f1 Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:51:07.344275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:51:07.346011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81777430895b432999f69033667e59f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81777430895b432999f69033667e59f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81777430895b432999f69033667e59f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81777430895b432999f69033667e59f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:51:07.346011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:51:07.346011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 81777430895b432999f69033667e59f1 Jul 14 11:51:07.346011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:51:07.346011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-AttachVolumeShelveTestJSON-2001742360-project Jul 14 11:51:07.346011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:51:07.346011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:51:07.346011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 899cbac79d874b308b500651bb40b2a7 Jul 14 11:51:07.346011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2001742360-project Jul 14 11:51:07.346011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:51:07.346011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. Jul 14 11:51:07.346011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': 'e08c817f-cc75-4c71-8645-51a7a1938404'} Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:51:07.347209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. Jul 14 11:51:07.348651 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:07.351469 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3efed90c-db56-41cd-a0b9-faf70622b3f7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Returning 404 to user: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:51:07.352514 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3efed90c-db56-41cd-a0b9-faf70622b3f7 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 404 len: 111 microversion: 2.20 time: 0.051962 Jul 14 11:51:07.353840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 457/961] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:51:07 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:51:07.363073 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-740f0935-ba69-492d-ba50-2980448cac53 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '.version_select at 0x7f1adf5d9f70>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:07.499204 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-740f0935-ba69-492d-ba50-2980448cac53 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891798121" status: 204 len: 0 microversion: 2.20 time: 0.140952 Jul 14 11:51:07.505071 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 505/962] 10.222.0.40 () {60 vars in 1261 bytes} [Thu Jul 14 11:51:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891798121 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 11:51:08.056916 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4a8ff2f8-5225-4077-9448-b3ad0b13e684 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:08.057932 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-4a8ff2f8-5225-4077-9448-b3ad0b13e684 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] [instance: ee797cbe-7b7e-4e87-9da7-0c628ae3ede1] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:08.065186 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4a8ff2f8-5225-4077-9448-b3ad0b13e684 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:08.066152 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4a8ff2f8-5225-4077-9448-b3ad0b13e684 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:08.067104 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4a8ff2f8-5225-4077-9448-b3ad0b13e684 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:08.067995 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4a8ff2f8-5225-4077-9448-b3ad0b13e684 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:08.110419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-4a8ff2f8-5225-4077-9448-b3ad0b13e684 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] HTTP exception thrown: Instance ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 could not be found. Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4a8ff2f8-5225-4077-9448-b3ad0b13e684 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Request method failure captured: Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 HTTP/1.1 Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AHd_1TDQvzzW-CajbzOakmZgaH2zAX6_vb_hjMq_Dn8G4BFlODpdhwcnSPzt24H09VgPl_ix1f4XiiJdsUSRIcb8RA7RXfrzri0jAXLNlEKt2L3oRr0Z7HNdVXbWgWRPWuYA14b6jENdPdMNHiXUQW3Sbv-jOKT8UQrvJCy0TJ2rqM Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: ca23768669a74586a221c14ebaa8ee26 Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-TestShelveInstance-1746815617 Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:51:08.113481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:51:08.116245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ca23768669a74586a221c14ebaa8ee26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ca23768669a74586a221c14ebaa8ee26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ca23768669a74586a221c14ebaa8ee26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ca23768669a74586a221c14ebaa8ee26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:51:08.116245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-TestShelveInstance-1746815617 Jul 14 11:51:08.116245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: ca23768669a74586a221c14ebaa8ee26 Jul 14 11:51:08.116245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-TestShelveInstance-1746815617 Jul 14 11:51:08.116245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-TestShelveInstance-1746815617-project Jul 14 11:51:08.116245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:51:08.116245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:51:08.116245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: d352cf5c00ae450c9a7ca4dcc68a87db Jul 14 11:51:08.116245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-TestShelveInstance-1746815617-project Jul 14 11:51:08.116245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:51:08.116245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 could not be found. Jul 14 11:51:08.116245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': 'ee797cbe-7b7e-4e87-9da7-0c628ae3ede1'} Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 could not be found. Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:51:08.117849 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 could not be found. Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 could not be found. Jul 14 11:51:08.120663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:08.123200 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4a8ff2f8-5225-4077-9448-b3ad0b13e684 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Returning 404 to user: Instance ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:51:08.123200 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-4a8ff2f8-5225-4077-9448-b3ad0b13e684 tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1" status: 404 len: 111 microversion: 2.1 time: 0.062456 Jul 14 11:51:08.123200 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 458/963] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:51:08 2022] GET /compute/v2.1/servers/ee797cbe-7b7e-4e87-9da7-0c628ae3ede1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:51:08.463158 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-4a43f0d3-5b5e-47dc-a076-732c60aa20dc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] Calling method '.version_select at 0x7f1adf5ecee0>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:08.580814 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-4a43f0d3-5b5e-47dc-a076-732c60aa20dc tempest-TestShelveInstance-1746815617 tempest-TestShelveInstance-1746815617-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-350530210" status: 202 len: 0 microversion: 2.1 time: 0.122044 Jul 14 11:51:08.581534 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 506/964] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 11:51:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-350530210 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:51:10.295229 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a51abb96-7df6-4141-8a77-628f3aad7369 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:10.296442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a51abb96-7df6-4141-8a77-628f3aad7369 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:10.303981 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a51abb96-7df6-4141-8a77-628f3aad7369 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:10.304702 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a51abb96-7df6-4141-8a77-628f3aad7369 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:10.305519 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a51abb96-7df6-4141-8a77-628f3aad7369 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:10.306647 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a51abb96-7df6-4141-8a77-628f3aad7369 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:10.325336 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-a51abb96-7df6-4141-8a77-628f3aad7369 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] HTTP exception thrown: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a51abb96-7df6-4141-8a77-628f3aad7369 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Request method failure captured: Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: DELETE /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 HTTP/1.1 Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGMSn7vQegOUWmSGgr_EOwUboZjvtuC0z2ZIkI74vrcApT1meUEh0Vm2NexV6jNnwhFR25jj32KjYlT0TcKdhtN8PZJAKqHjUiNEGHQfuvToxMYoOH28RYTOr5HgE_PdImIc_-bsBaF1kyOpLe_k8NBL4OqUd_t3VZ6Yz_FbzY6BNI Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 81777430895b432999f69033667e59f1 Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:51:10.327784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:51:10.335776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81777430895b432999f69033667e59f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81777430895b432999f69033667e59f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81777430895b432999f69033667e59f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81777430895b432999f69033667e59f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:51:10.335776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:51:10.335776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 81777430895b432999f69033667e59f1 Jul 14 11:51:10.335776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:51:10.335776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-AttachVolumeShelveTestJSON-2001742360-project Jul 14 11:51:10.335776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:51:10.335776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:51:10.335776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 899cbac79d874b308b500651bb40b2a7 Jul 14 11:51:10.335776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2001742360-project Jul 14 11:51:10.335776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:51:10.335776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. Jul 14 11:51:10.335776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': 'e08c817f-cc75-4c71-8645-51a7a1938404'} Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:51:10.336888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. Jul 14 11:51:10.338579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:10.340283 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a51abb96-7df6-4141-8a77-628f3aad7369 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Returning 404 to user: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:51:10.340283 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a51abb96-7df6-4141-8a77-628f3aad7369 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 404 len: 111 microversion: 2.20 time: 0.037945 Jul 14 11:51:10.340283 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 459/965] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jul 14 11:51:10 2022] DELETE /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:51:10.340532 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-978e2633-12c7-4449-8378-1d1bc942fc7a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:10.340532 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-978e2633-12c7-4449-8378-1d1bc942fc7a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: e08c817f-cc75-4c71-8645-51a7a1938404] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:10.346755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-978e2633-12c7-4449-8378-1d1bc942fc7a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:10.347770 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-978e2633-12c7-4449-8378-1d1bc942fc7a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:10.348616 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-978e2633-12c7-4449-8378-1d1bc942fc7a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:10.349377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-978e2633-12c7-4449-8378-1d1bc942fc7a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:10.368266 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-978e2633-12c7-4449-8378-1d1bc942fc7a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] HTTP exception thrown: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-978e2633-12c7-4449-8378-1d1bc942fc7a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Request method failure captured: Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 HTTP/1.1 Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AGMSn7vQegOUWmSGgr_EOwUboZjvtuC0z2ZIkI74vrcApT1meUEh0Vm2NexV6jNnwhFR25jj32KjYlT0TcKdhtN8PZJAKqHjUiNEGHQfuvToxMYoOH28RYTOr5HgE_PdImIc_-bsBaF1kyOpLe_k8NBL4OqUd_t3VZ6Yz_FbzY6BNI Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 81777430895b432999f69033667e59f1 Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:51:10.370054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:51:10.371718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81777430895b432999f69033667e59f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81777430895b432999f69033667e59f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81777430895b432999f69033667e59f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81777430895b432999f69033667e59f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:51:10.371718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:51:10.371718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 81777430895b432999f69033667e59f1 Jul 14 11:51:10.371718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:51:10.371718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-AttachVolumeShelveTestJSON-2001742360-project Jul 14 11:51:10.371718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:51:10.371718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:51:10.371718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 899cbac79d874b308b500651bb40b2a7 Jul 14 11:51:10.371718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2001742360-project Jul 14 11:51:10.371718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:51:10.371718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. Jul 14 11:51:10.371718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': 'e08c817f-cc75-4c71-8645-51a7a1938404'} Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:51:10.372621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. Jul 14 11:51:10.374139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:10.375415 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-978e2633-12c7-4449-8378-1d1bc942fc7a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Returning 404 to user: Instance e08c817f-cc75-4c71-8645-51a7a1938404 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:51:10.375415 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-978e2633-12c7-4449-8378-1d1bc942fc7a tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404" status: 404 len: 111 microversion: 2.20 time: 0.037113 Jul 14 11:51:10.375415 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 507/966] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:51:10 2022] GET /compute/v2.1/servers/e08c817f-cc75-4c71-8645-51a7a1938404 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:51:11.828737 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-62edc88e-02df-4fb8-a1e6-40324662e7e8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:11.829252 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-62edc88e-02df-4fb8-a1e6-40324662e7e8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:11.835909 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-62edc88e-02df-4fb8-a1e6-40324662e7e8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:11.836348 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-62edc88e-02df-4fb8-a1e6-40324662e7e8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:11.837355 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-62edc88e-02df-4fb8-a1e6-40324662e7e8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:11.837982 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-62edc88e-02df-4fb8-a1e6-40324662e7e8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-62edc88e-02df-4fb8-a1e6-40324662e7e8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] HTTP exception thrown: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-62edc88e-02df-4fb8-a1e6-40324662e7e8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Request method failure captured: Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: DELETE /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 HTTP/1.1 Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AGMSn7vQegOUWmSGgr_EOwUboZjvtuC0z2ZIkI74vrcApT1meUEh0Vm2NexV6jNnwhFR25jj32KjYlT0TcKdhtN8PZJAKqHjUiNEGHQfuvToxMYoOH28RYTOr5HgE_PdImIc_-bsBaF1kyOpLe_k8NBL4OqUd_t3VZ6Yz_FbzY6BNI Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 81777430895b432999f69033667e59f1 Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:51:11.855782 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:51:11.857592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81777430895b432999f69033667e59f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81777430895b432999f69033667e59f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81777430895b432999f69033667e59f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81777430895b432999f69033667e59f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:51:11.857592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:51:11.857592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 81777430895b432999f69033667e59f1 Jul 14 11:51:11.857592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:51:11.857592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-AttachVolumeShelveTestJSON-2001742360-project Jul 14 11:51:11.857592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:51:11.857592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:51:11.857592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 899cbac79d874b308b500651bb40b2a7 Jul 14 11:51:11.857592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2001742360-project Jul 14 11:51:11.857592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:51:11.857592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. Jul 14 11:51:11.857592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '03f44195-49ec-496b-937e-eb9722a215c0'} Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:51:11.858338 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. Jul 14 11:51:11.859587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:11.860840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-62edc88e-02df-4fb8-a1e6-40324662e7e8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Returning 404 to user: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:51:11.860840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-62edc88e-02df-4fb8-a1e6-40324662e7e8 tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 404 len: 111 microversion: 2.20 time: 0.030595 Jul 14 11:51:11.860840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 460/967] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jul 14 11:51:11 2022] DELETE /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:51:11.864944 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5aa0c20e-855d-485e-97a1-70eaec34951b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:11.865582 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-5aa0c20e-855d-485e-97a1-70eaec34951b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] [instance: 03f44195-49ec-496b-937e-eb9722a215c0] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:51:11.871925 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5aa0c20e-855d-485e-97a1-70eaec34951b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:11.872365 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5aa0c20e-855d-485e-97a1-70eaec34951b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:11.873135 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5aa0c20e-855d-485e-97a1-70eaec34951b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:51:11.873617 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5aa0c20e-855d-485e-97a1-70eaec34951b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:51:11.887139 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-5aa0c20e-855d-485e-97a1-70eaec34951b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] HTTP exception thrown: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5aa0c20e-855d-485e-97a1-70eaec34951b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Request method failure captured: Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 HTTP/1.1 Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AGMSn7vQegOUWmSGgr_EOwUboZjvtuC0z2ZIkI74vrcApT1meUEh0Vm2NexV6jNnwhFR25jj32KjYlT0TcKdhtN8PZJAKqHjUiNEGHQfuvToxMYoOH28RYTOr5HgE_PdImIc_-bsBaF1kyOpLe_k8NBL4OqUd_t3VZ6Yz_FbzY6BNI Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 81777430895b432999f69033667e59f1 Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:51:11.888688 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:51:11.890217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81777430895b432999f69033667e59f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81777430895b432999f69033667e59f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81777430895b432999f69033667e59f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81777430895b432999f69033667e59f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:51:11.890217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:51:11.890217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 81777430895b432999f69033667e59f1 Jul 14 11:51:11.890217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2001742360 Jul 14 11:51:11.890217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-AttachVolumeShelveTestJSON-2001742360-project Jul 14 11:51:11.890217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:51:11.890217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:51:11.890217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 899cbac79d874b308b500651bb40b2a7 Jul 14 11:51:11.890217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2001742360-project Jul 14 11:51:11.890217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:51:11.890217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. Jul 14 11:51:11.890217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': '03f44195-49ec-496b-937e-eb9722a215c0'} Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:51:11.891048 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. Jul 14 11:51:11.892272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:11.894715 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5aa0c20e-855d-485e-97a1-70eaec34951b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] Returning 404 to user: Instance 03f44195-49ec-496b-937e-eb9722a215c0 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:51:11.894715 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-5aa0c20e-855d-485e-97a1-70eaec34951b tempest-AttachVolumeShelveTestJSON-2001742360 tempest-AttachVolumeShelveTestJSON-2001742360-project] 10.222.0.40 "GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0" status: 404 len: 111 microversion: 2.20 time: 0.030193 Jul 14 11:51:11.894715 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 508/968] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 11:51:11 2022] GET /compute/v2.1/servers/03f44195-49ec-496b-937e-eb9722a215c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:51:22.422431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:51:22.423499 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:51:22.735452 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-92d366eb-c79b-4404-87d4-3e8651990375 tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] Action: 'create', calling method: .version_select at 0x7f1adf664940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-935828166", "metadata": {"Type": "work"}}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:51:23.596011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-92d366eb-c79b-4404-87d4-3e8651990375 tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.179187 Jul 14 11:51:23.608887 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 461/969] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jul 14 11:51:22 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1193 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 11:51:23.610111 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-dc039f78-3d74-46b3-aec6-fe4181c0e511 tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] Calling method '.version_select at 0x7f1adf56b700>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:23.623398 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:51:23.623398 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=40 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:51:23.671099 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-dc039f78-3d74-46b3-aec6-fe4181c0e511 tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/10772927-1ecf-4432-be6c-b362048910a8" status: 200 len: 352 microversion: 2.1 time: 0.065835 Jul 14 11:51:23.671864 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 509/970] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 11:51:23 2022] GET /compute/v2.1/os-volumes/10772927-1ecf-4432-be6c-b362048910a8 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:51:24.685653 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-17fe5abe-51cb-4b6a-9c34-a2e6f2e8cf4f tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] Calling method '.version_select at 0x7f1adf668310>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:24.953634 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-17fe5abe-51cb-4b6a-9c34-a2e6f2e8cf4f tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/10772927-1ecf-4432-be6c-b362048910a8" status: 200 len: 353 microversion: 2.1 time: 0.272797 Jul 14 11:51:24.954168 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 462/971] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 11:51:24 2022] GET /compute/v2.1/os-volumes/10772927-1ecf-4432-be6c-b362048910a8 => generated 353 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:51:24.965461 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-06abbf7f-be04-4850-a55e-8cb64ccd65c1 tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] Calling method '.version_select at 0x7f1adf5ec940>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:25.060329 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-06abbf7f-be04-4850-a55e-8cb64ccd65c1 tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/10772927-1ecf-4432-be6c-b362048910a8" status: 200 len: 353 microversion: 2.1 time: 0.098670 Jul 14 11:51:25.060943 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 510/972] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 11:51:24 2022] GET /compute/v2.1/os-volumes/10772927-1ecf-4432-be6c-b362048910a8 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:51:25.072924 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e2d1f8d1-b9a1-4a6d-9f13-88bdadd8cd66 tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] Calling method '.version_select at 0x7f1adf668ca0>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:25.362375 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e2d1f8d1-b9a1-4a6d-9f13-88bdadd8cd66 tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/10772927-1ecf-4432-be6c-b362048910a8" status: 202 len: 0 microversion: 2.1 time: 0.293143 Jul 14 11:51:25.362886 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 463/973] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 11:51:25 2022] DELETE /compute/v2.1/os-volumes/10772927-1ecf-4432-be6c-b362048910a8 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:51:25.370953 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8ce283a7-efdf-4a23-93b9-72e00eb1e2c8 tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] Calling method '.version_select at 0x7f1adf56b160>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:25.430405 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-8ce283a7-efdf-4a23-93b9-72e00eb1e2c8 tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/10772927-1ecf-4432-be6c-b362048910a8" status: 200 len: 352 microversion: 2.1 time: 0.063148 Jul 14 11:51:25.431167 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 511/974] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 11:51:25 2022] GET /compute/v2.1/os-volumes/10772927-1ecf-4432-be6c-b362048910a8 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:51:26.455304 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-66aaed67-499d-44e3-a283-b1db1bc9c512 tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] Calling method '.version_select at 0x7f1adf6648b0>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:26.652624 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-66aaed67-499d-44e3-a283-b1db1bc9c512 tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] HTTP exception thrown: Volume 10772927-1ecf-4432-be6c-b362048910a8 could not be found. Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-66aaed67-499d-44e3-a283-b1db1bc9c512 tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] Request method failure captured: Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/os-volumes/10772927-1ecf-4432-be6c-b362048910a8 HTTP/1.1 Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AM6AkLaQi4dBJppXUvmq_ir7GCMlo98vFxxDQt4_gLo5y6RJL2wv5XMPYFRf8sVzp4myY5hfb6YGrn2QyCJiCJXDwTbyxgOTPiu0uhMLlt5rtOJlzs5t8Zx2D2ONk7QHxMiHVbNNCI-5sdqJqWLxSnRc6aZMvVQtLk2xyay9lsFopU Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 0f68263b01c64cbd8c759ba840c949f7 Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-VolumesGetTestJSON-2115650473 Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:51:26.654419 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:51:26.656209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0f68263b01c64cbd8c759ba840c949f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0f68263b01c64cbd8c759ba840c949f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0f68263b01c64cbd8c759ba840c949f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0f68263b01c64cbd8c759ba840c949f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:51:26.656209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-VolumesGetTestJSON-2115650473 Jul 14 11:51:26.656209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 0f68263b01c64cbd8c759ba840c949f7 Jul 14 11:51:26.656209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-VolumesGetTestJSON-2115650473 Jul 14 11:51:26.656209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-VolumesGetTestJSON-2115650473-project Jul 14 11:51:26.656209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:51:26.656209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:51:26.656209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 0db86d876f484602abe6964ea79c8da8 Jul 14 11:51:26.656209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-VolumesGetTestJSON-2115650473-project Jul 14 11:51:26.656209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: Jul 14 11:51:26.656209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Volume 10772927-1ecf-4432-be6c-b362048910a8 could not be found. Jul 14 11:51:26.656209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '10772927-1ecf-4432-be6c-b362048910a8'} Jul 14 11:51:26.656209 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 10772927-1ecf-4432-be6c-b362048910a8 could not be found. (HTTP 404) (Request-ID: req-c9a2ca32-9d17-48c1-a624-137b9e9ad324) Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:26.657297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:51:26.659151 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 10772927-1ecf-4432-be6c-b362048910a8 could not be found. Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 11:51:26.660573 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:51:26.662194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 10772927-1ecf-4432-be6c-b362048910a8 could not be found. Jul 14 11:51:26.662194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:26.662194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:26.662194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:26.662194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:26.662194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:26.662194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:26.662194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:51:26.662194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:51:26.662194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 10772927-1ecf-4432-be6c-b362048910a8 could not be found. Jul 14 11:51:26.662194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:26.662194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-66aaed67-499d-44e3-a283-b1db1bc9c512 tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] Returning 404 to user: Volume 10772927-1ecf-4432-be6c-b362048910a8 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:51:26.662194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-66aaed67-499d-44e3-a283-b1db1bc9c512 tempest-VolumesGetTestJSON-2115650473 tempest-VolumesGetTestJSON-2115650473-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/10772927-1ecf-4432-be6c-b362048910a8" status: 404 len: 109 microversion: 2.1 time: 0.218295 Jul 14 11:51:26.668467 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 464/975] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 11:51:26 2022] GET /compute/v2.1/os-volumes/10772927-1ecf-4432-be6c-b362048910a8 => generated 109 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:51:29.468755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a9926f8a-6e8d-437a-8ccc-0e504fee2583 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Action: 'create', calling method: .version_select at 0x7f1adf5ec8b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1012668016", "metadata": {"Type": "work"}}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a9926f8a-6e8d-437a-8ccc-0e504fee2583 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Request method failure captured: Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 122 Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0ANBnNZ-hGHLm-1B2mi486MvxkxN6vMm2J_jB9eG_CfmbhvWMSjn5z2LtLhr7LGwzUWUkA-sk9norcj2b9O1FsmlBc7D6OjiWiebHRq6mWuFzZswUShPdRrTt_uhKHSlmGNjz8aIUJxhrweWVWIBy4JvnT5YHaACgJUvakhpdkGIo5Y Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: e23b064dd6fd481a97cf3a9c47cb98db Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:51:29.497600 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:51:29.499197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:51:29.499197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.499197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: e23b064dd6fd481a97cf3a9c47cb98db Jul 14 11:51:29.499197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.499197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-VolumesNegativeTest-1941196420-project Jul 14 11:51:29.499197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:51:29.499197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:51:29.499197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: d61090e529984229aa0f6841a4bb122b Jul 14 11:51:29.499197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-VolumesNegativeTest-1941196420-project Jul 14 11:51:29.499197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Jul 14 11:51:29.499197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1012668016", "metadata": {"Type": "work"}}} Jul 14 11:51:29.499197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: Jul 14 11:51:29.499197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1012668016', 'metadata': {'Type': 'work'}}}} Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise error Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:51:29.500093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 11:51:29.501730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 11:51:29.502942 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 11:51:29.502942 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.505777 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a9926f8a-6e8d-437a-8ccc-0e504fee2583 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:51:29.506946 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a9926f8a-6e8d-437a-8ccc-0e504fee2583 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.271988 Jul 14 11:51:29.511364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 512/976] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jul 14 11:51:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 277 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:51:29.519945 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-706e1836-3111-48f0-a623-b8b543d981ec tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Action: 'create', calling method: .version_select at 0x7f1adf668c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-302859945", "metadata": {"Type": "work"}}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-706e1836-3111-48f0-a623-b8b543d981ec tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Request method failure captured: Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 119 Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0ANBnNZ-hGHLm-1B2mi486MvxkxN6vMm2J_jB9eG_CfmbhvWMSjn5z2LtLhr7LGwzUWUkA-sk9norcj2b9O1FsmlBc7D6OjiWiebHRq6mWuFzZswUShPdRrTt_uhKHSlmGNjz8aIUJxhrweWVWIBy4JvnT5YHaACgJUvakhpdkGIo5Y Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: e23b064dd6fd481a97cf3a9c47cb98db Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:51:29.524559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:51:29.526216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:51:29.526216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.526216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: e23b064dd6fd481a97cf3a9c47cb98db Jul 14 11:51:29.526216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.526216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-VolumesNegativeTest-1941196420-project Jul 14 11:51:29.526216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:51:29.526216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:51:29.526216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: d61090e529984229aa0f6841a4bb122b Jul 14 11:51:29.526216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-VolumesNegativeTest-1941196420-project Jul 14 11:51:29.526216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Jul 14 11:51:29.526216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-302859945", "metadata": {"Type": "work"}}} Jul 14 11:51:29.526216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: Jul 14 11:51:29.526216 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-302859945', 'metadata': {'Type': 'work'}}}} Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise error Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi '0' Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:51:29.527096 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 11:51:29.528457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 11:51:29.531127 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 11:51:29.531127 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.531127 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-706e1836-3111-48f0-a623-b8b543d981ec tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:51:29.531127 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-706e1836-3111-48f0-a623-b8b543d981ec tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013343 Jul 14 11:51:29.531127 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 465/977] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jul 14 11:51:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 11:51:29.543320 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ab4e7473-934b-4775-a168-efebb293304c tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Action: 'create', calling method: .version_select at 0x7f1adf670a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-813105148", "metadata": {"Type": "work"}}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ab4e7473-934b-4775-a168-efebb293304c tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Request method failure captured: Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 118 Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0ANBnNZ-hGHLm-1B2mi486MvxkxN6vMm2J_jB9eG_CfmbhvWMSjn5z2LtLhr7LGwzUWUkA-sk9norcj2b9O1FsmlBc7D6OjiWiebHRq6mWuFzZswUShPdRrTt_uhKHSlmGNjz8aIUJxhrweWVWIBy4JvnT5YHaACgJUvakhpdkGIo5Y Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: e23b064dd6fd481a97cf3a9c47cb98db Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:51:29.550041 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:51:29.551818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:51:29.551818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.551818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: e23b064dd6fd481a97cf3a9c47cb98db Jul 14 11:51:29.551818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.551818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-VolumesNegativeTest-1941196420-project Jul 14 11:51:29.551818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:51:29.551818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:51:29.551818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: d61090e529984229aa0f6841a4bb122b Jul 14 11:51:29.551818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-VolumesNegativeTest-1941196420-project Jul 14 11:51:29.551818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Jul 14 11:51:29.551818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-813105148", "metadata": {"Type": "work"}}} Jul 14 11:51:29.551818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: Jul 14 11:51:29.551818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-813105148', 'metadata': {'Type': 'work'}}}} Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise error Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi '' Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:51:29.552820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 11:51:29.554545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 11:51:29.555980 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 11:51:29.555980 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.559266 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ab4e7473-934b-4775-a168-efebb293304c tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:51:29.565320 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ab4e7473-934b-4775-a168-efebb293304c tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024611 Jul 14 11:51:29.565320 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 513/978] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jul 14 11:51:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 11:51:29.578219 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a9298625-0d14-46fd-aa65-a2d3d71ce429 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Calling method '.version_select at 0x7f1adf664af0>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:29.640442 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-a9298625-0d14-46fd-aa65-a2d3d71ce429 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] HTTP exception thrown: Volume tempest-invalid-37120017 could not be found. Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a9298625-0d14-46fd-aa65-a2d3d71ce429 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Request method failure captured: Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-37120017 HTTP/1.1 Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0ANBnNZ-hGHLm-1B2mi486MvxkxN6vMm2J_jB9eG_CfmbhvWMSjn5z2LtLhr7LGwzUWUkA-sk9norcj2b9O1FsmlBc7D6OjiWiebHRq6mWuFzZswUShPdRrTt_uhKHSlmGNjz8aIUJxhrweWVWIBy4JvnT5YHaACgJUvakhpdkGIo5Y Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: e23b064dd6fd481a97cf3a9c47cb98db Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:51:29.643141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:51:29.644559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:51:29.644559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.644559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: e23b064dd6fd481a97cf3a9c47cb98db Jul 14 11:51:29.644559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.644559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-VolumesNegativeTest-1941196420-project Jul 14 11:51:29.644559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:51:29.644559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:51:29.644559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: d61090e529984229aa0f6841a4bb122b Jul 14 11:51:29.644559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-VolumesNegativeTest-1941196420-project Jul 14 11:51:29.644559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: Jul 14 11:51:29.644559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Volume tempest-invalid-37120017 could not be found. Jul 14 11:51:29.644559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': 'tempest-invalid-37120017'} Jul 14 11:51:29.644559 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-37120017 could not be found. (HTTP 404) (Request-ID: req-423bc401-9171-4801-9986-7807be364c3e) Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:29.649026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:51:29.650371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-37120017 could not be found. Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:51:29.651543 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-37120017 could not be found. Jul 14 11:51:29.653013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.653013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:29.653013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.653013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.653013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:29.653013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:29.653013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:51:29.653013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:51:29.653013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-37120017 could not be found. Jul 14 11:51:29.653013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.653013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a9298625-0d14-46fd-aa65-a2d3d71ce429 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Returning 404 to user: Volume tempest-invalid-37120017 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:51:29.653013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a9298625-0d14-46fd-aa65-a2d3d71ce429 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-37120017" status: 404 len: 97 microversion: 2.1 time: 0.077626 Jul 14 11:51:29.653013 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 466/979] 10.222.0.40 () {58 vars in 1211 bytes} [Thu Jul 14 11:51:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-37120017 => generated 97 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 11:51:29.658553 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-079ed96c-440c-42cb-b070-cd3049aa60fa tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004736 Jul 14 11:51:29.659749 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 514/980] 10.222.0.40 () {58 vars in 1139 bytes} [Thu Jul 14 11:51:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 11:51:29.670618 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-efd68a94-ce12-488a-9336-eaa6e4f82453 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004856 Jul 14 11:51:29.671148 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 467/981] 10.222.0.40 () {58 vars in 1136 bytes} [Thu Jul 14 11:51:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 11:51:29.686779 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c224a014-6606-4ba7-8f4b-9ac3a4be2f98 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Calling method '.version_select at 0x7f1adf622790>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:29.715902 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-c224a014-6606-4ba7-8f4b-9ac3a4be2f98 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] HTTP exception thrown: Volume c348eb7b-73be-4de9-bd22-85612fc2d054 could not be found. Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c224a014-6606-4ba7-8f4b-9ac3a4be2f98 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Request method failure captured: Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: DELETE /compute/v2.1/os-volumes/c348eb7b-73be-4de9-bd22-85612fc2d054 HTTP/1.1 Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0ANBnNZ-hGHLm-1B2mi486MvxkxN6vMm2J_jB9eG_CfmbhvWMSjn5z2LtLhr7LGwzUWUkA-sk9norcj2b9O1FsmlBc7D6OjiWiebHRq6mWuFzZswUShPdRrTt_uhKHSlmGNjz8aIUJxhrweWVWIBy4JvnT5YHaACgJUvakhpdkGIo5Y Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: e23b064dd6fd481a97cf3a9c47cb98db Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:51:29.717997 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:51:29.719709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:51:29.719709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.719709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: e23b064dd6fd481a97cf3a9c47cb98db Jul 14 11:51:29.719709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.719709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-VolumesNegativeTest-1941196420-project Jul 14 11:51:29.719709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:51:29.719709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:51:29.719709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: d61090e529984229aa0f6841a4bb122b Jul 14 11:51:29.719709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-VolumesNegativeTest-1941196420-project Jul 14 11:51:29.719709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: Jul 14 11:51:29.719709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Volume c348eb7b-73be-4de9-bd22-85612fc2d054 could not be found. Jul 14 11:51:29.719709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': 'c348eb7b-73be-4de9-bd22-85612fc2d054'} Jul 14 11:51:29.719709 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c348eb7b-73be-4de9-bd22-85612fc2d054 could not be found. (HTTP 404) (Request-ID: req-eb5bde39-900a-4599-af52-e3a5f85cbd20) Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:29.721609 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:51:29.722853 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c348eb7b-73be-4de9-bd22-85612fc2d054 could not be found. Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 11:51:29.724053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:51:29.726216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c348eb7b-73be-4de9-bd22-85612fc2d054 could not be found. Jul 14 11:51:29.726216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.726216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:29.726216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.726216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.726216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:29.726216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:29.726216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:51:29.726216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:51:29.726216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c348eb7b-73be-4de9-bd22-85612fc2d054 could not be found. Jul 14 11:51:29.726216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.726216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c224a014-6606-4ba7-8f4b-9ac3a4be2f98 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Returning 404 to user: Volume c348eb7b-73be-4de9-bd22-85612fc2d054 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:51:29.726216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c224a014-6606-4ba7-8f4b-9ac3a4be2f98 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/c348eb7b-73be-4de9-bd22-85612fc2d054" status: 404 len: 109 microversion: 2.1 time: 0.037662 Jul 14 11:51:29.726216 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 515/982] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 11:51:29 2022] DELETE /compute/v2.1/os-volumes/c348eb7b-73be-4de9-bd22-85612fc2d054 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:51:29.730394 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-76f60d89-27c2-481d-be31-feb04dbb1405 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Calling method '.version_select at 0x7f1adf664d30>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:51:29.758624 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-76f60d89-27c2-481d-be31-feb04dbb1405 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] HTTP exception thrown: Volume 8bab1bb7-059d-4c2a-a12d-2f58feae2b70 could not be found. Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-76f60d89-27c2-481d-be31-feb04dbb1405 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Request method failure captured: Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/os-volumes/8bab1bb7-059d-4c2a-a12d-2f58feae2b70 HTTP/1.1 Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0ANBnNZ-hGHLm-1B2mi486MvxkxN6vMm2J_jB9eG_CfmbhvWMSjn5z2LtLhr7LGwzUWUkA-sk9norcj2b9O1FsmlBc7D6OjiWiebHRq6mWuFzZswUShPdRrTt_uhKHSlmGNjz8aIUJxhrweWVWIBy4JvnT5YHaACgJUvakhpdkGIo5Y Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: e23b064dd6fd481a97cf3a9c47cb98db Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:51:29.760589 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:51:29.762760 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e23b064dd6fd481a97cf3a9c47cb98db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:51:29.762760 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.762760 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: e23b064dd6fd481a97cf3a9c47cb98db Jul 14 11:51:29.762760 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-VolumesNegativeTest-1941196420 Jul 14 11:51:29.762760 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-VolumesNegativeTest-1941196420-project Jul 14 11:51:29.762760 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:51:29.762760 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:51:29.762760 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: d61090e529984229aa0f6841a4bb122b Jul 14 11:51:29.762760 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-VolumesNegativeTest-1941196420-project Jul 14 11:51:29.762760 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: Jul 14 11:51:29.762760 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Volume 8bab1bb7-059d-4c2a-a12d-2f58feae2b70 could not be found. Jul 14 11:51:29.762760 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '8bab1bb7-059d-4c2a-a12d-2f58feae2b70'} Jul 14 11:51:29.762760 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8bab1bb7-059d-4c2a-a12d-2f58feae2b70 could not be found. (HTTP 404) (Request-ID: req-21844317-a887-434b-8263-111eb72e3ac2) Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:29.764054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:51:29.765241 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8bab1bb7-059d-4c2a-a12d-2f58feae2b70 could not be found. Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 11:51:29.766423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:51:29.768836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8bab1bb7-059d-4c2a-a12d-2f58feae2b70 could not be found. Jul 14 11:51:29.768836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.768836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:51:29.768836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.768836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:51:29.768836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:51:29.768836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:51:29.768836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:51:29.768836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:51:29.768836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8bab1bb7-059d-4c2a-a12d-2f58feae2b70 could not be found. Jul 14 11:51:29.768836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:51:29.768836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-76f60d89-27c2-481d-be31-feb04dbb1405 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] Returning 404 to user: Volume 8bab1bb7-059d-4c2a-a12d-2f58feae2b70 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:51:29.768836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-76f60d89-27c2-481d-be31-feb04dbb1405 tempest-VolumesNegativeTest-1941196420 tempest-VolumesNegativeTest-1941196420-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8bab1bb7-059d-4c2a-a12d-2f58feae2b70" status: 404 len: 109 microversion: 2.1 time: 0.036151 Jul 14 11:51:29.773545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 468/983] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 11:51:29 2022] GET /compute/v2.1/os-volumes/8bab1bb7-059d-4c2a-a12d-2f58feae2b70 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:51:39.012915 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-49fce625-b2e9-4133-8d33-6d688cc9ef51 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Action: 'create', calling method: .version_select at 0x7f1adf622e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-634704875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFwigkSu+AZzccvawY5ExLJ8V6CFr04OwRAv/g/2BJoM2UUvna2gbF0fllkIarsaa6C4ojdTG4iYEOo3RtP4lpVYxIXflj1yq9gaInb2eduRs2e4yaJ0q/xH8vxeMXOBg=="}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:51:39.029454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-49fce625-b2e9-4133-8d33-6d688cc9ef51 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Getting quotas for project 7119e46a06b54c2984b21f32d9c156e3. Resources: {'key_pairs'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:51:39.034206 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-49fce625-b2e9-4133-8d33-6d688cc9ef51 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Getting quotas for user 1a71cad9c9114c5cb0bf8b4fe982e4d5 and project 7119e46a06b54c2984b21f32d9c156e3. Resources: {'key_pairs'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:51:39.152552 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-49fce625-b2e9-4133-8d33-6d688cc9ef51 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.358290 Jul 14 11:51:39.156350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 516/984] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 11:51:38 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:52:15.088934 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-531554745", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-634704875", "security_groups": [{"name": "tempest-secgroup-smoke-630221934"}], "block_device_mapping_v2": [{"uuid": "cb88522f-02c9-4c67-a83e-875ce4990f10", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c22b4386-d3cd-4949-9a26-72cae23c6f3e"}]}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:52:15.245415 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.network.neutron [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] validate_networks() for [('c22b4386-d3cd-4949-9a26-72cae23c6f3e', None, None, None, None, None)] {{(pid=124946) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:52:15.621842 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Flavor limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:52:15.622261 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Image limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:52:15.622730 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Flavor pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:52:15.623137 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Image pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:52:15.623553 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:52:15.633126 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:15.633613 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:15.634410 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:15.634846 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:15.652781 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Getting quotas for project 7119e46a06b54c2984b21f32d9c156e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:52:15.656723 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Getting quotas for user 1a71cad9c9114c5cb0bf8b4fe982e4d5 and project 7119e46a06b54c2984b21f32d9c156e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:52:15.712576 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Going to run 1 instances... {{(pid=124946) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:52:15.714766 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb88522f-02c9-4c67-a83e-875ce4990f10',volume_size=None,volume_type=None)] {{(pid=124946) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:52:16.036999 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR oslo.messaging._drivers.impl_rabbit [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [084d3b84-0b76-499a-9331-6a141e8091a5] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 11:52:17.047275 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO oslo.messaging._drivers.impl_rabbit [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [084d3b84-0b76-499a-9331-6a141e8091a5] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 48774. Jul 14 11:52:17.053939 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-834ee496-01b1-4db4-ba1c-ce30a0acec61 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.968408 Jul 14 11:52:17.053939 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 469/985] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:52:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:52:17.064660 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=4 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:52:17.065445 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:52:17.070583 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-345ccd2f-6cd9-4027-bf54-4e7c5054ab94 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:17.070583 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-345ccd2f-6cd9-4027-bf54-4e7c5054ab94 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:17.123274 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-345ccd2f-6cd9-4027-bf54-4e7c5054ab94 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:17.130183 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-345ccd2f-6cd9-4027-bf54-4e7c5054ab94 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1093 microversion: 2.1 time: 0.066945 Jul 14 11:52:17.130798 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 517/986] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:17 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:18.148885 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e49d74b4-4e86-4332-a735-73a440db4d24 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:18.149526 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e49d74b4-4e86-4332-a735-73a440db4d24 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:18.202046 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e49d74b4-4e86-4332-a735-73a440db4d24 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:18.209037 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e49d74b4-4e86-4332-a735-73a440db4d24 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1093 microversion: 2.1 time: 0.064855 Jul 14 11:52:18.209654 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 470/987] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:18 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:19.228157 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-bcc1eb30-b96a-4281-9bc5-7f6b36cd2fa3 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:19.228773 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-bcc1eb30-b96a-4281-9bc5-7f6b36cd2fa3 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:19.285843 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-bcc1eb30-b96a-4281-9bc5-7f6b36cd2fa3 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:19.292455 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-bcc1eb30-b96a-4281-9bc5-7f6b36cd2fa3 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1093 microversion: 2.1 time: 0.068681 Jul 14 11:52:19.293005 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 518/988] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:19 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:20.309210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-94115802-ce28-461f-bb6a-61c0afa7db53 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:20.309834 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-94115802-ce28-461f-bb6a-61c0afa7db53 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:20.361102 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-94115802-ce28-461f-bb6a-61c0afa7db53 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:20.367820 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-94115802-ce28-461f-bb6a-61c0afa7db53 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1093 microversion: 2.1 time: 0.062681 Jul 14 11:52:20.368394 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 471/989] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:20 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:21.384409 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-cb385b6b-a1d3-4f6f-8627-2fe9d1653123 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:21.385011 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-cb385b6b-a1d3-4f6f-8627-2fe9d1653123 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:21.391918 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cb385b6b-a1d3-4f6f-8627-2fe9d1653123 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:21.392361 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cb385b6b-a1d3-4f6f-8627-2fe9d1653123 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:21.393172 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cb385b6b-a1d3-4f6f-8627-2fe9d1653123 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:21.393606 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cb385b6b-a1d3-4f6f-8627-2fe9d1653123 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:21.457527 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-cb385b6b-a1d3-4f6f-8627-2fe9d1653123 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:21.465107 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-cb385b6b-a1d3-4f6f-8627-2fe9d1653123 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1143 microversion: 2.1 time: 0.084580 Jul 14 11:52:21.465721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 519/990] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:21 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:22.482908 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6d2b716b-f49e-4c63-9351-36f0f749dffd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:22.483531 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6d2b716b-f49e-4c63-9351-36f0f749dffd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:22.491523 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6d2b716b-f49e-4c63-9351-36f0f749dffd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:22.491974 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6d2b716b-f49e-4c63-9351-36f0f749dffd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:22.492830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6d2b716b-f49e-4c63-9351-36f0f749dffd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:22.493218 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6d2b716b-f49e-4c63-9351-36f0f749dffd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:22.558297 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6d2b716b-f49e-4c63-9351-36f0f749dffd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:22.565619 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6d2b716b-f49e-4c63-9351-36f0f749dffd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1143 microversion: 2.1 time: 0.087272 Jul 14 11:52:22.566185 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 472/991] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:22 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1143 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:23.582350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-cb64a175-5228-4836-9b48-5cfd1c2cd760 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:23.582970 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-cb64a175-5228-4836-9b48-5cfd1c2cd760 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:23.589595 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cb64a175-5228-4836-9b48-5cfd1c2cd760 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:23.590124 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cb64a175-5228-4836-9b48-5cfd1c2cd760 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:23.590897 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cb64a175-5228-4836-9b48-5cfd1c2cd760 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:23.591338 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-cb64a175-5228-4836-9b48-5cfd1c2cd760 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:23.651668 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-cb64a175-5228-4836-9b48-5cfd1c2cd760 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:23.659059 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-cb64a175-5228-4836-9b48-5cfd1c2cd760 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1143 microversion: 2.1 time: 0.080622 Jul 14 11:52:23.659620 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 520/992] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:23 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1143 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:24.676359 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-fcb5f9ff-c584-4614-9023-53435f9bc9bd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:24.676969 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-fcb5f9ff-c584-4614-9023-53435f9bc9bd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:24.684054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fcb5f9ff-c584-4614-9023-53435f9bc9bd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:24.684500 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fcb5f9ff-c584-4614-9023-53435f9bc9bd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:24.685287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fcb5f9ff-c584-4614-9023-53435f9bc9bd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:24.685725 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-fcb5f9ff-c584-4614-9023-53435f9bc9bd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:24.746111 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-fcb5f9ff-c584-4614-9023-53435f9bc9bd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:24.754055 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-fcb5f9ff-c584-4614-9023-53435f9bc9bd tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1135 microversion: 2.1 time: 0.081501 Jul 14 11:52:24.754809 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 473/993] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:24 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1135 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:25.784847 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d9637f02-5aea-4369-b252-4d2554a638ee tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:25.784847 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d9637f02-5aea-4369-b252-4d2554a638ee tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:25.784847 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d9637f02-5aea-4369-b252-4d2554a638ee tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:25.784847 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d9637f02-5aea-4369-b252-4d2554a638ee tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:25.786187 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d9637f02-5aea-4369-b252-4d2554a638ee tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:25.786187 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d9637f02-5aea-4369-b252-4d2554a638ee tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:25.853057 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d9637f02-5aea-4369-b252-4d2554a638ee tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:25.861255 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d9637f02-5aea-4369-b252-4d2554a638ee tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1199 microversion: 2.1 time: 0.093703 Jul 14 11:52:25.861790 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 521/994] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:25 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1199 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:26.878375 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-65176140-fd81-4a70-bbbb-dfff2f351049 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:26.878992 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-65176140-fd81-4a70-bbbb-dfff2f351049 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:26.880874 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:52:26.886498 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-65176140-fd81-4a70-bbbb-dfff2f351049 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:26.893354 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-65176140-fd81-4a70-bbbb-dfff2f351049 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:26.893354 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-65176140-fd81-4a70-bbbb-dfff2f351049 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:26.893354 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-65176140-fd81-4a70-bbbb-dfff2f351049 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:26.951425 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-65176140-fd81-4a70-bbbb-dfff2f351049 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:26.958735 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-65176140-fd81-4a70-bbbb-dfff2f351049 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1199 microversion: 2.1 time: 0.084285 Jul 14 11:52:26.959299 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 474/995] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:26 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1199 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:27.975769 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c3f37f39-1b8f-4efe-8185-fd699bf88f7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:27.976375 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c3f37f39-1b8f-4efe-8185-fd699bf88f7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:27.983560 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c3f37f39-1b8f-4efe-8185-fd699bf88f7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:27.984000 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c3f37f39-1b8f-4efe-8185-fd699bf88f7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:27.984762 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c3f37f39-1b8f-4efe-8185-fd699bf88f7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:27.985206 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c3f37f39-1b8f-4efe-8185-fd699bf88f7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:28.048636 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-c3f37f39-1b8f-4efe-8185-fd699bf88f7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:28.056061 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c3f37f39-1b8f-4efe-8185-fd699bf88f7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1199 microversion: 2.1 time: 0.084157 Jul 14 11:52:28.056613 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 522/996] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:27 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1199 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:52:29.073327 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9f911edd-d853-478f-bd92-e9737eb9461b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:29.074000 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9f911edd-d853-478f-bd92-e9737eb9461b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:29.084228 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9f911edd-d853-478f-bd92-e9737eb9461b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:29.084699 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9f911edd-d853-478f-bd92-e9737eb9461b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:29.085706 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9f911edd-d853-478f-bd92-e9737eb9461b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:29.086150 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9f911edd-d853-478f-bd92-e9737eb9461b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:29.228600 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9f911edd-d853-478f-bd92-e9737eb9461b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:29.237055 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9f911edd-d853-478f-bd92-e9737eb9461b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1276 microversion: 2.1 time: 0.168294 Jul 14 11:52:29.237829 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 475/997] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:29 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:30.098156 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-e7355cb4-1d41-476c-b587-dcd130593bf9 req-d5291459-8993-4f92-9a55-e8647e55448b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cec7809b-bc37-4ba9-9481-743c85a10de8", "tag": "13845ba0-8394-4994-8f3a-c990a6595f50"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:52:30.106134 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=4 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:52:30.108252 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-e7355cb4-1d41-476c-b587-dcd130593bf9 req-d5291459-8993-4f92-9a55-e8647e55448b service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:30.112172 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-e7355cb4-1d41-476c-b587-dcd130593bf9 req-d5291459-8993-4f92-9a55-e8647e55448b service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:30.127479 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-e7355cb4-1d41-476c-b587-dcd130593bf9 req-d5291459-8993-4f92-9a55-e8647e55448b service nova] Creating event network-changed:13845ba0-8394-4994-8f3a-c990a6595f50 for instance cec7809b-bc37-4ba9-9481-743c85a10de8 on hv-cinder-84980 Jul 14 11:52:30.134524 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-e7355cb4-1d41-476c-b587-dcd130593bf9 req-d5291459-8993-4f92-9a55-e8647e55448b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040137 Jul 14 11:52:30.137259 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 523/998] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:52:30.255513 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4c385dc8-5513-4e27-8935-5a134b46c4f7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:30.256922 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-4c385dc8-5513-4e27-8935-5a134b46c4f7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:30.268057 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4c385dc8-5513-4e27-8935-5a134b46c4f7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:30.268794 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4c385dc8-5513-4e27-8935-5a134b46c4f7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:30.270064 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4c385dc8-5513-4e27-8935-5a134b46c4f7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:30.271520 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4c385dc8-5513-4e27-8935-5a134b46c4f7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:30.370948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=10 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:52:30.486728 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-4c385dc8-5513-4e27-8935-5a134b46c4f7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:30.498897 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-4c385dc8-5513-4e27-8935-5a134b46c4f7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1264 microversion: 2.1 time: 0.245331 Jul 14 11:52:30.498897 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 476/999] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:30 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1264 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:31.514055 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d07b7088-6180-4a0c-8982-28e890fcecd7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:31.516828 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d07b7088-6180-4a0c-8982-28e890fcecd7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:31.521841 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d07b7088-6180-4a0c-8982-28e890fcecd7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:31.522293 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d07b7088-6180-4a0c-8982-28e890fcecd7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:31.523072 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d07b7088-6180-4a0c-8982-28e890fcecd7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:31.523514 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d07b7088-6180-4a0c-8982-28e890fcecd7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:31.675662 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d07b7088-6180-4a0c-8982-28e890fcecd7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:31.683439 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d07b7088-6180-4a0c-8982-28e890fcecd7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1264 microversion: 2.1 time: 0.174195 Jul 14 11:52:31.684021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 524/1000] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:31 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:32.710005 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-c004cca8-ca98-437b-82f9-8f92816c5e40 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:32.710840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-c004cca8-ca98-437b-82f9-8f92816c5e40 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:32.718229 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c004cca8-ca98-437b-82f9-8f92816c5e40 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:32.718621 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c004cca8-ca98-437b-82f9-8f92816c5e40 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:32.719592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c004cca8-ca98-437b-82f9-8f92816c5e40 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:32.720033 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-c004cca8-ca98-437b-82f9-8f92816c5e40 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:32.888285 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-c004cca8-ca98-437b-82f9-8f92816c5e40 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:32.896325 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-c004cca8-ca98-437b-82f9-8f92816c5e40 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1264 microversion: 2.1 time: 0.197721 Jul 14 11:52:32.898611 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 477/1001] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:32 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:33.913281 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a29dccc0-cdf8-4166-ab0d-21cc9dd03347 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:33.913952 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a29dccc0-cdf8-4166-ab0d-21cc9dd03347 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:33.921762 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a29dccc0-cdf8-4166-ab0d-21cc9dd03347 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:33.922259 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a29dccc0-cdf8-4166-ab0d-21cc9dd03347 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:33.923051 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a29dccc0-cdf8-4166-ab0d-21cc9dd03347 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:33.923494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a29dccc0-cdf8-4166-ab0d-21cc9dd03347 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:34.077092 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a29dccc0-cdf8-4166-ab0d-21cc9dd03347 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:34.085112 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a29dccc0-cdf8-4166-ab0d-21cc9dd03347 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1264 microversion: 2.1 time: 0.175650 Jul 14 11:52:34.089195 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 525/1002] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:33 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:35.103597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6fc0f359-11a6-489e-a406-a27cc6274476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:35.104238 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6fc0f359-11a6-489e-a406-a27cc6274476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:35.111234 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6fc0f359-11a6-489e-a406-a27cc6274476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:35.111691 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6fc0f359-11a6-489e-a406-a27cc6274476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:35.112465 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6fc0f359-11a6-489e-a406-a27cc6274476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:35.113104 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6fc0f359-11a6-489e-a406-a27cc6274476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:35.279983 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6fc0f359-11a6-489e-a406-a27cc6274476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:35.288777 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6fc0f359-11a6-489e-a406-a27cc6274476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1264 microversion: 2.1 time: 0.189215 Jul 14 11:52:35.290133 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 478/1003] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:35 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:36.306280 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-90cb0b32-239d-4e33-8942-d33265a9eee0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:36.306888 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-90cb0b32-239d-4e33-8942-d33265a9eee0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:36.313495 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90cb0b32-239d-4e33-8942-d33265a9eee0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:36.314949 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90cb0b32-239d-4e33-8942-d33265a9eee0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:36.314949 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90cb0b32-239d-4e33-8942-d33265a9eee0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:36.315281 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-90cb0b32-239d-4e33-8942-d33265a9eee0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:36.461474 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-90cb0b32-239d-4e33-8942-d33265a9eee0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:36.463735 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-90cb0b32-239d-4e33-8942-d33265a9eee0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1264 microversion: 2.1 time: 0.161321 Jul 14 11:52:36.464327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 526/1004] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:36 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:52:37.482355 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6c324c3b-ba70-4686-943a-f46a3ce2e3a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:37.482885 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6c324c3b-ba70-4686-943a-f46a3ce2e3a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:37.497303 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6c324c3b-ba70-4686-943a-f46a3ce2e3a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:37.497303 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6c324c3b-ba70-4686-943a-f46a3ce2e3a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:37.497303 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6c324c3b-ba70-4686-943a-f46a3ce2e3a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:37.497303 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6c324c3b-ba70-4686-943a-f46a3ce2e3a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:37.627711 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6c324c3b-ba70-4686-943a-f46a3ce2e3a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:37.636193 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6c324c3b-ba70-4686-943a-f46a3ce2e3a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1264 microversion: 2.1 time: 0.158421 Jul 14 11:52:37.641695 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 479/1005] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:37 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:38.653560 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d18431ab-3dc6-4feb-9a80-9f60fb91c05a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:38.654939 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d18431ab-3dc6-4feb-9a80-9f60fb91c05a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:38.660916 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d18431ab-3dc6-4feb-9a80-9f60fb91c05a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:38.661424 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d18431ab-3dc6-4feb-9a80-9f60fb91c05a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:38.662188 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d18431ab-3dc6-4feb-9a80-9f60fb91c05a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:38.662619 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d18431ab-3dc6-4feb-9a80-9f60fb91c05a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:38.805784 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d18431ab-3dc6-4feb-9a80-9f60fb91c05a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:38.813463 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d18431ab-3dc6-4feb-9a80-9f60fb91c05a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1264 microversion: 2.1 time: 0.164300 Jul 14 11:52:38.814026 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 527/1006] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:38 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:39.830665 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-1d99cc0c-ed24-4349-992e-2a844fbbd3ef tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:39.831532 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-1d99cc0c-ed24-4349-992e-2a844fbbd3ef tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:39.847950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1d99cc0c-ed24-4349-992e-2a844fbbd3ef tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:39.848407 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1d99cc0c-ed24-4349-992e-2a844fbbd3ef tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:39.849208 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1d99cc0c-ed24-4349-992e-2a844fbbd3ef tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:39.849652 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1d99cc0c-ed24-4349-992e-2a844fbbd3ef tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:39.996210 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-1d99cc0c-ed24-4349-992e-2a844fbbd3ef tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:40.003917 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-1d99cc0c-ed24-4349-992e-2a844fbbd3ef tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1264 microversion: 2.1 time: 0.177237 Jul 14 11:52:40.004482 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 480/1007] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:39 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:40.827953 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-9756b696-8163-45ab-bf69-e6f7209cc805 req-59949e48-b0e4-4177-b77a-678466cdf7ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec7809b-bc37-4ba9-9481-743c85a10de8", "name": "network-vif-plugged", "status": "completed", "tag": "13845ba0-8394-4994-8f3a-c990a6595f50"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:52:40.837404 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-9756b696-8163-45ab-bf69-e6f7209cc805 req-59949e48-b0e4-4177-b77a-678466cdf7ac service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:40.837813 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-9756b696-8163-45ab-bf69-e6f7209cc805 req-59949e48-b0e4-4177-b77a-678466cdf7ac service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:40.849705 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-9756b696-8163-45ab-bf69-e6f7209cc805 req-59949e48-b0e4-4177-b77a-678466cdf7ac service nova] Creating event network-vif-plugged:13845ba0-8394-4994-8f3a-c990a6595f50 for instance cec7809b-bc37-4ba9-9481-743c85a10de8 on hv-cinder-84980 Jul 14 11:52:40.854594 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-9756b696-8163-45ab-bf69-e6f7209cc805 req-59949e48-b0e4-4177-b77a-678466cdf7ac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030366 Jul 14 11:52:40.855354 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 528/1008] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:52:41.022412 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-41e22ba1-0f12-4efa-898a-c3752033f51e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:41.023060 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-41e22ba1-0f12-4efa-898a-c3752033f51e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:41.029626 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-41e22ba1-0f12-4efa-898a-c3752033f51e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:41.030071 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-41e22ba1-0f12-4efa-898a-c3752033f51e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:41.030837 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-41e22ba1-0f12-4efa-898a-c3752033f51e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:41.031272 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-41e22ba1-0f12-4efa-898a-c3752033f51e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:41.168422 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-41e22ba1-0f12-4efa-898a-c3752033f51e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:41.178587 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-41e22ba1-0f12-4efa-898a-c3752033f51e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1264 microversion: 2.1 time: 0.160234 Jul 14 11:52:41.179784 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 481/1009] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:41 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:42.196439 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-80764477-ae44-4f72-83c1-27b6585bbd98 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:42.197140 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-80764477-ae44-4f72-83c1-27b6585bbd98 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:42.204419 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-80764477-ae44-4f72-83c1-27b6585bbd98 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:42.204860 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-80764477-ae44-4f72-83c1-27b6585bbd98 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:42.206990 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-80764477-ae44-4f72-83c1-27b6585bbd98 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:42.206990 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-80764477-ae44-4f72-83c1-27b6585bbd98 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:42.341222 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-80764477-ae44-4f72-83c1-27b6585bbd98 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:42.350047 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-80764477-ae44-4f72-83c1-27b6585bbd98 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1264 microversion: 2.1 time: 0.159098 Jul 14 11:52:42.350632 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 529/1010] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:42 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:52:43.367335 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-951eb262-1ef2-4376-8094-a9aa3c68e458 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:43.367958 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-951eb262-1ef2-4376-8094-a9aa3c68e458 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:43.374615 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-951eb262-1ef2-4376-8094-a9aa3c68e458 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:43.375272 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-951eb262-1ef2-4376-8094-a9aa3c68e458 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:43.376061 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-951eb262-1ef2-4376-8094-a9aa3c68e458 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:43.376678 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-951eb262-1ef2-4376-8094-a9aa3c68e458 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:43.513457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-951eb262-1ef2-4376-8094-a9aa3c68e458 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:43.521536 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-951eb262-1ef2-4376-8094-a9aa3c68e458 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1451 microversion: 2.1 time: 0.158197 Jul 14 11:52:43.522107 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 482/1011] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:43 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:43.538622 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-88ce8db9-6b7a-4e47-b816-1167ebf5bab8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:52:43.539265 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-88ce8db9-6b7a-4e47-b816-1167ebf5bab8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:52:43.545758 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-88ce8db9-6b7a-4e47-b816-1167ebf5bab8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:43.550649 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-88ce8db9-6b7a-4e47-b816-1167ebf5bab8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:43.550649 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-88ce8db9-6b7a-4e47-b816-1167ebf5bab8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:43.550649 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-88ce8db9-6b7a-4e47-b816-1167ebf5bab8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:43.689446 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-88ce8db9-6b7a-4e47-b816-1167ebf5bab8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:52:43.697194 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-88ce8db9-6b7a-4e47-b816-1167ebf5bab8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1451 microversion: 2.1 time: 0.162767 Jul 14 11:52:43.697761 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 530/1012] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:52:43 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:52:46.547881 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-df5d9160-eeea-4e49-af9a-49b998f2621f req-2d1b4b9a-3252-43bb-8e34-f9f0450e3334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cec7809b-bc37-4ba9-9481-743c85a10de8", "tag": "13845ba0-8394-4994-8f3a-c990a6595f50"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:52:46.552973 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:52:46.557400 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-df5d9160-eeea-4e49-af9a-49b998f2621f req-2d1b4b9a-3252-43bb-8e34-f9f0450e3334 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:52:46.557853 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-df5d9160-eeea-4e49-af9a-49b998f2621f req-2d1b4b9a-3252-43bb-8e34-f9f0450e3334 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:52:46.562494 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=69 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:52:46.571534 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-df5d9160-eeea-4e49-af9a-49b998f2621f req-2d1b4b9a-3252-43bb-8e34-f9f0450e3334 service nova] Creating event network-changed:13845ba0-8394-4994-8f3a-c990a6595f50 for instance cec7809b-bc37-4ba9-9481-743c85a10de8 on hv-cinder-84980 Jul 14 11:52:46.577174 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-df5d9160-eeea-4e49-af9a-49b998f2621f req-2d1b4b9a-3252-43bb-8e34-f9f0450e3334 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033004 Jul 14 11:52:46.577846 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 483/1013] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:53:31.153172 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1424407184", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "networks": [{"uuid": "b461a243-e81b-4dc6-aba3-95839533f8ad"}]}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:53:31.160425 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=32 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:53:31.161086 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=64 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:53:31.205506 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.network.neutron [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] validate_networks() for [('b461a243-e81b-4dc6-aba3-95839533f8ad', None, None, None, None, None)] {{(pid=124947) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:53:31.598339 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Flavor limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:53:31.598766 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Image limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:53:31.599241 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Flavor pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:53:31.599680 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Image pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:53:31.600094 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:53:31.609744 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:31.610194 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:31.610995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:31.611434 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:31.629138 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Getting quotas for project e9905cd8264640fc99e83d869129d85a. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:53:31.633147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Getting quotas for user 485159da9ec14f44b398c3cc618d3d84 and project e9905cd8264640fc99e83d869129d85a. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:53:31.644231 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Going to run 1 instances... {{(pid=124947) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:53:31.646547 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:53:31.754723 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [b747474f-2536-43bd-8235-8c940674331e] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 11:53:32.764524 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO oslo.messaging._drivers.impl_rabbit [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [b747474f-2536-43bd-8235-8c940674331e] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 50026. Jul 14 11:53:32.768935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7cb391a6-1064-4131-9a23-9c56c52ccdfb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.619684 Jul 14 11:53:32.769643 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 531/1014] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:53:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:53:32.781525 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-00f70380-7d9d-48ef-9ab6-fe6f43f616af tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:32.782233 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-00f70380-7d9d-48ef-9ab6-fe6f43f616af tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:32.839388 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-00f70380-7d9d-48ef-9ab6-fe6f43f616af tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:32.846551 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-00f70380-7d9d-48ef-9ab6-fe6f43f616af tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 200 len: 1214 microversion: 2.1 time: 0.070772 Jul 14 11:53:32.847133 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 484/1015] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:32 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:33.864194 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1b936daf-4415-4631-8ea9-6e08ff665a5c tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:33.867471 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1b936daf-4415-4631-8ea9-6e08ff665a5c tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:33.872801 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1b936daf-4415-4631-8ea9-6e08ff665a5c tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:33.873311 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1b936daf-4415-4631-8ea9-6e08ff665a5c tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:33.874090 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1b936daf-4415-4631-8ea9-6e08ff665a5c tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:33.874526 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1b936daf-4415-4631-8ea9-6e08ff665a5c tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:33.935987 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1b936daf-4415-4631-8ea9-6e08ff665a5c tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:33.943484 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1b936daf-4415-4631-8ea9-6e08ff665a5c tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 200 len: 1218 microversion: 2.1 time: 0.083824 Jul 14 11:53:33.944039 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 532/1016] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:33 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:34.960244 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-f95538b2-1095-403a-8757-8b9a5a07a8d3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:34.960845 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-f95538b2-1095-403a-8757-8b9a5a07a8d3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:34.968511 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f95538b2-1095-403a-8757-8b9a5a07a8d3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:34.968983 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f95538b2-1095-403a-8757-8b9a5a07a8d3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:34.969857 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f95538b2-1095-403a-8757-8b9a5a07a8d3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:34.970294 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f95538b2-1095-403a-8757-8b9a5a07a8d3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:35.032968 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f95538b2-1095-403a-8757-8b9a5a07a8d3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:35.040501 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-f95538b2-1095-403a-8757-8b9a5a07a8d3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 200 len: 1284 microversion: 2.1 time: 0.084135 Jul 14 11:53:35.041089 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 485/1017] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:34 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:36.058006 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9b3c7c5b-20ac-49b6-b8fa-aeb54ec294b8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:36.058655 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9b3c7c5b-20ac-49b6-b8fa-aeb54ec294b8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:36.065116 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9b3c7c5b-20ac-49b6-b8fa-aeb54ec294b8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:36.066528 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9b3c7c5b-20ac-49b6-b8fa-aeb54ec294b8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:36.066528 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9b3c7c5b-20ac-49b6-b8fa-aeb54ec294b8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:36.066869 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9b3c7c5b-20ac-49b6-b8fa-aeb54ec294b8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:36.269656 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9b3c7c5b-20ac-49b6-b8fa-aeb54ec294b8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:36.278197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9b3c7c5b-20ac-49b6-b8fa-aeb54ec294b8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 200 len: 1314 microversion: 2.1 time: 0.223964 Jul 14 11:53:36.278776 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 533/1018] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:36 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:36.476685 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-08ef67bb-02a0-43b7-a7b5-2eadad1af12a req-b6cc209c-1841-4ee1-bb17-25a5d8868f4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e820f5db-08dd-4219-809f-1d19d72cddee", "tag": "75367271-8f8c-4c3c-8939-f562e54ba6b2"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:53:36.485258 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-08ef67bb-02a0-43b7-a7b5-2eadad1af12a req-b6cc209c-1841-4ee1-bb17-25a5d8868f4f service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:36.485973 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-08ef67bb-02a0-43b7-a7b5-2eadad1af12a req-b6cc209c-1841-4ee1-bb17-25a5d8868f4f service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:36.500683 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-08ef67bb-02a0-43b7-a7b5-2eadad1af12a req-b6cc209c-1841-4ee1-bb17-25a5d8868f4f service nova] Creating event network-changed:75367271-8f8c-4c3c-8939-f562e54ba6b2 for instance e820f5db-08dd-4219-809f-1d19d72cddee on hv-cinder-84980 Jul 14 11:53:36.505615 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-08ef67bb-02a0-43b7-a7b5-2eadad1af12a req-b6cc209c-1841-4ee1-bb17-25a5d8868f4f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033306 Jul 14 11:53:36.506260 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 486/1019] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:53:37.296017 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-56a3e661-f8eb-4c20-a712-64c622f0e024 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:37.296613 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-56a3e661-f8eb-4c20-a712-64c622f0e024 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:37.303288 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-56a3e661-f8eb-4c20-a712-64c622f0e024 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:37.303735 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-56a3e661-f8eb-4c20-a712-64c622f0e024 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:37.304506 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-56a3e661-f8eb-4c20-a712-64c622f0e024 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:37.304942 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-56a3e661-f8eb-4c20-a712-64c622f0e024 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:37.439071 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-56a3e661-f8eb-4c20-a712-64c622f0e024 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:37.447502 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-56a3e661-f8eb-4c20-a712-64c622f0e024 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 200 len: 1314 microversion: 2.1 time: 0.154831 Jul 14 11:53:37.448073 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 534/1020] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:37 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:38.464907 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d9f2bfa3-a497-4d75-b7ec-c1de0f9b127e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:38.465643 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d9f2bfa3-a497-4d75-b7ec-c1de0f9b127e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:38.472431 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d9f2bfa3-a497-4d75-b7ec-c1de0f9b127e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:38.472909 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d9f2bfa3-a497-4d75-b7ec-c1de0f9b127e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:38.473698 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d9f2bfa3-a497-4d75-b7ec-c1de0f9b127e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:38.474135 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d9f2bfa3-a497-4d75-b7ec-c1de0f9b127e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:38.606972 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d9f2bfa3-a497-4d75-b7ec-c1de0f9b127e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:38.614474 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d9f2bfa3-a497-4d75-b7ec-c1de0f9b127e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 200 len: 1314 microversion: 2.1 time: 0.153823 Jul 14 11:53:38.615037 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 487/1021] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:38 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:39.636721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d05fd82a-426c-479e-b2ef-532af969186a tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:39.637826 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d05fd82a-426c-479e-b2ef-532af969186a tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:39.648473 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d05fd82a-426c-479e-b2ef-532af969186a tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:39.649055 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d05fd82a-426c-479e-b2ef-532af969186a tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:39.649881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d05fd82a-426c-479e-b2ef-532af969186a tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:39.650325 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d05fd82a-426c-479e-b2ef-532af969186a tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:39.785958 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-d05fd82a-426c-479e-b2ef-532af969186a tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:39.794215 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d05fd82a-426c-479e-b2ef-532af969186a tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 200 len: 1314 microversion: 2.1 time: 0.166427 Jul 14 11:53:39.794782 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 535/1022] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:39 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:40.811647 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-89297131-3957-4416-9526-a0e0576ed971 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:40.812260 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-89297131-3957-4416-9526-a0e0576ed971 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:40.818860 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-89297131-3957-4416-9526-a0e0576ed971 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:40.819315 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-89297131-3957-4416-9526-a0e0576ed971 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:40.820083 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-89297131-3957-4416-9526-a0e0576ed971 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:40.820526 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-89297131-3957-4416-9526-a0e0576ed971 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:40.949926 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-89297131-3957-4416-9526-a0e0576ed971 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:40.957411 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-89297131-3957-4416-9526-a0e0576ed971 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 200 len: 1314 microversion: 2.1 time: 0.149605 Jul 14 11:53:40.957979 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 488/1023] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:40 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:41.974271 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-13798e65-9c88-49d9-98fd-2b72349c93b6 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:41.974864 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-13798e65-9c88-49d9-98fd-2b72349c93b6 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:41.977194 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:53:41.978390 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=6 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:53:41.983321 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-13798e65-9c88-49d9-98fd-2b72349c93b6 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:41.983763 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-13798e65-9c88-49d9-98fd-2b72349c93b6 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:41.984548 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-13798e65-9c88-49d9-98fd-2b72349c93b6 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:41.984984 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-13798e65-9c88-49d9-98fd-2b72349c93b6 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:42.115836 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-13798e65-9c88-49d9-98fd-2b72349c93b6 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:42.124299 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-13798e65-9c88-49d9-98fd-2b72349c93b6 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 200 len: 1314 microversion: 2.1 time: 0.153880 Jul 14 11:53:42.125024 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 536/1024] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:41 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:43.049076 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-9fc732cd-9602-4043-98db-911409762d2a req-1dbecef1-216d-4bdd-be21-da8b400840d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e820f5db-08dd-4219-809f-1d19d72cddee", "name": "network-vif-plugged", "status": "completed", "tag": "75367271-8f8c-4c3c-8939-f562e54ba6b2"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:53:43.053236 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:53:43.058479 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-9fc732cd-9602-4043-98db-911409762d2a req-1dbecef1-216d-4bdd-be21-da8b400840d4 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:43.058915 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-9fc732cd-9602-4043-98db-911409762d2a req-1dbecef1-216d-4bdd-be21-da8b400840d4 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:43.069583 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-9fc732cd-9602-4043-98db-911409762d2a req-1dbecef1-216d-4bdd-be21-da8b400840d4 service nova] Creating event network-vif-plugged:75367271-8f8c-4c3c-8939-f562e54ba6b2 for instance e820f5db-08dd-4219-809f-1d19d72cddee on hv-cinder-84980 Jul 14 11:53:43.074560 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-9fc732cd-9602-4043-98db-911409762d2a req-1dbecef1-216d-4bdd-be21-da8b400840d4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029303 Jul 14 11:53:43.075143 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 489/1025] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:53:43.140480 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a3212a57-cad7-4913-94a1-9e143fa27597 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:43.141130 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a3212a57-cad7-4913-94a1-9e143fa27597 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:43.148003 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a3212a57-cad7-4913-94a1-9e143fa27597 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:43.148475 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a3212a57-cad7-4913-94a1-9e143fa27597 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:43.149298 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a3212a57-cad7-4913-94a1-9e143fa27597 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:43.150830 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a3212a57-cad7-4913-94a1-9e143fa27597 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:43.293858 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a3212a57-cad7-4913-94a1-9e143fa27597 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:43.301349 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a3212a57-cad7-4913-94a1-9e143fa27597 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 200 len: 1314 microversion: 2.1 time: 0.164893 Jul 14 11:53:43.301929 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 537/1026] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:43 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:44.319672 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b7437785-e9af-40a5-886c-11b7d9c486ce tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:44.320368 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b7437785-e9af-40a5-886c-11b7d9c486ce tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:44.326696 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b7437785-e9af-40a5-886c-11b7d9c486ce tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:44.327140 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b7437785-e9af-40a5-886c-11b7d9c486ce tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:44.327900 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b7437785-e9af-40a5-886c-11b7d9c486ce tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:44.328334 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b7437785-e9af-40a5-886c-11b7d9c486ce tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:44.457095 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b7437785-e9af-40a5-886c-11b7d9c486ce tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:44.465267 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b7437785-e9af-40a5-886c-11b7d9c486ce tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 200 len: 1314 microversion: 2.1 time: 0.150545 Jul 14 11:53:44.465850 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 490/1027] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:44 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:53:45.482063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ae7b3df0-e33a-4db5-bc70-6a387648d721 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:45.482659 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ae7b3df0-e33a-4db5-bc70-6a387648d721 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:45.489372 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ae7b3df0-e33a-4db5-bc70-6a387648d721 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:45.489819 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ae7b3df0-e33a-4db5-bc70-6a387648d721 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:45.490586 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ae7b3df0-e33a-4db5-bc70-6a387648d721 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:45.491021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ae7b3df0-e33a-4db5-bc70-6a387648d721 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:45.619047 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ae7b3df0-e33a-4db5-bc70-6a387648d721 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:45.626546 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ae7b3df0-e33a-4db5-bc70-6a387648d721 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 200 len: 1498 microversion: 2.1 time: 0.149055 Jul 14 11:53:45.627107 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 538/1028] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:45 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:46.299688 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d004e149-774a-4377-b8ee-8ac53a241549 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:46.300228 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d004e149-774a-4377-b8ee-8ac53a241549 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:46.306731 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d004e149-774a-4377-b8ee-8ac53a241549 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:46.312095 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d004e149-774a-4377-b8ee-8ac53a241549 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:46.312095 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d004e149-774a-4377-b8ee-8ac53a241549 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:46.312095 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d004e149-774a-4377-b8ee-8ac53a241549 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:46.334072 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d004e149-774a-4377-b8ee-8ac53a241549 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Going to try to terminate instance {{(pid=124946) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:53:46.611828 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d004e149-774a-4377-b8ee-8ac53a241549 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 204 len: 0 microversion: 2.1 time: 0.315719 Jul 14 11:53:46.612441 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 491/1029] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:53:46 2022] DELETE /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:53:46.620679 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-313acd2d-fb23-4a09-a6aa-1096b6c82d43 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:46.621470 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-313acd2d-fb23-4a09-a6aa-1096b6c82d43 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:46.629004 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-313acd2d-fb23-4a09-a6aa-1096b6c82d43 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:46.631818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-313acd2d-fb23-4a09-a6aa-1096b6c82d43 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:46.631818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-313acd2d-fb23-4a09-a6aa-1096b6c82d43 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:46.631818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-313acd2d-fb23-4a09-a6aa-1096b6c82d43 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:46.763424 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-313acd2d-fb23-4a09-a6aa-1096b6c82d43 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:46.771205 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-313acd2d-fb23-4a09-a6aa-1096b6c82d43 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 200 len: 1504 microversion: 2.1 time: 0.154411 Jul 14 11:53:46.771770 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 539/1030] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:46 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:53:47.788803 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3b22927d-2341-426a-8a1a-99f59e0e6207 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:47.789537 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3b22927d-2341-426a-8a1a-99f59e0e6207 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:47.796048 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3b22927d-2341-426a-8a1a-99f59e0e6207 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:47.796500 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3b22927d-2341-426a-8a1a-99f59e0e6207 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:47.797299 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3b22927d-2341-426a-8a1a-99f59e0e6207 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:47.797737 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3b22927d-2341-426a-8a1a-99f59e0e6207 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:47.932372 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-3b22927d-2341-426a-8a1a-99f59e0e6207 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:47.940520 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3b22927d-2341-426a-8a1a-99f59e0e6207 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 200 len: 1504 microversion: 2.1 time: 0.155940 Jul 14 11:53:47.941104 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 492/1031] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:47 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:48.464913 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-92b6b5ef-ffaf-4af5-bcb6-4a35f4616ee3 req-738ad544-9d23-406b-bd60-5f885eee29df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e820f5db-08dd-4219-809f-1d19d72cddee", "name": "network-vif-deleted", "tag": "75367271-8f8c-4c3c-8939-f562e54ba6b2"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:53:48.473750 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-92b6b5ef-ffaf-4af5-bcb6-4a35f4616ee3 req-738ad544-9d23-406b-bd60-5f885eee29df service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:48.474217 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-92b6b5ef-ffaf-4af5-bcb6-4a35f4616ee3 req-738ad544-9d23-406b-bd60-5f885eee29df service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:48.485831 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-92b6b5ef-ffaf-4af5-bcb6-4a35f4616ee3 req-738ad544-9d23-406b-bd60-5f885eee29df service nova] Creating event network-vif-deleted:75367271-8f8c-4c3c-8939-f562e54ba6b2 for instance e820f5db-08dd-4219-809f-1d19d72cddee on hv-cinder-84980 Jul 14 11:53:48.490939 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-92b6b5ef-ffaf-4af5-bcb6-4a35f4616ee3 req-738ad544-9d23-406b-bd60-5f885eee29df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030394 Jul 14 11:53:48.491513 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 540/1032] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:53:48.957088 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b0f9964f-060b-49be-a539-54d864aaf016 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:48.957735 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b0f9964f-060b-49be-a539-54d864aaf016 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:48.963977 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b0f9964f-060b-49be-a539-54d864aaf016 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:48.964429 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b0f9964f-060b-49be-a539-54d864aaf016 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:48.965219 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b0f9964f-060b-49be-a539-54d864aaf016 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:48.965659 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b0f9964f-060b-49be-a539-54d864aaf016 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:48.997615 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b0f9964f-060b-49be-a539-54d864aaf016 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:48.998057 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b0f9964f-060b-49be-a539-54d864aaf016 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:48.998498 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-b0f9964f-060b-49be-a539-54d864aaf016 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lazy-loading 'fault' on Instance uuid e820f5db-08dd-4219-809f-1d19d72cddee {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:53:49.040502 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b0f9964f-060b-49be-a539-54d864aaf016 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:49.048948 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b0f9964f-060b-49be-a539-54d864aaf016 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 200 len: 1304 microversion: 2.1 time: 0.095616 Jul 14 11:53:49.049541 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 493/1033] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:48 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:50.067109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c514b27a-9001-4455-9d3b-af5dda3ba7bb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:50.067736 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-c514b27a-9001-4455-9d3b-af5dda3ba7bb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: e820f5db-08dd-4219-809f-1d19d72cddee] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:50.074237 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c514b27a-9001-4455-9d3b-af5dda3ba7bb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:50.074687 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c514b27a-9001-4455-9d3b-af5dda3ba7bb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:50.075531 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c514b27a-9001-4455-9d3b-af5dda3ba7bb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:50.075978 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-c514b27a-9001-4455-9d3b-af5dda3ba7bb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:50.089643 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-c514b27a-9001-4455-9d3b-af5dda3ba7bb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] HTTP exception thrown: Instance e820f5db-08dd-4219-809f-1d19d72cddee could not be found. Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c514b27a-9001-4455-9d3b-af5dda3ba7bb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Request method failure captured: Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee HTTP/1.1 Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AO59877sE_5zl2vK8t6qBIm8BlEhdfPIj6etDKV4_9Q8CgFKzOR6-VTdP-S-l02VLeQhJDigglc8J1-X95a31TIDVciF2zq-Lp1rl_4IgsKtsJgOtmGEM8O95pfoHTTpXS0wGV0aBKe3GC2IdAC_G7zklCvvhj_cwX9yInJUfEgJtE Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: e9905cd8264640fc99e83d869129d85a Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-VolumesActionsTest-19856136 Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:53:50.091294 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:53:50.092928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e9905cd8264640fc99e83d869129d85a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e9905cd8264640fc99e83d869129d85a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e9905cd8264640fc99e83d869129d85a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e9905cd8264640fc99e83d869129d85a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:53:50.092928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-VolumesActionsTest-19856136 Jul 14 11:53:50.092928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: e9905cd8264640fc99e83d869129d85a Jul 14 11:53:50.092928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-VolumesActionsTest-19856136 Jul 14 11:53:50.092928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-VolumesActionsTest-19856136-project Jul 14 11:53:50.092928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:53:50.092928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:53:50.092928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 485159da9ec14f44b398c3cc618d3d84 Jul 14 11:53:50.092928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-VolumesActionsTest-19856136-project Jul 14 11:53:50.092928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:53:50.092928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance e820f5db-08dd-4219-809f-1d19d72cddee could not be found. Jul 14 11:53:50.092928 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': 'e820f5db-08dd-4219-809f-1d19d72cddee'} Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e820f5db-08dd-4219-809f-1d19d72cddee could not be found. Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:53:50.093995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e820f5db-08dd-4219-809f-1d19d72cddee could not be found. Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e820f5db-08dd-4219-809f-1d19d72cddee could not be found. Jul 14 11:53:50.095610 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:53:50.097359 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-c514b27a-9001-4455-9d3b-af5dda3ba7bb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Returning 404 to user: Instance e820f5db-08dd-4219-809f-1d19d72cddee could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:53:50.097359 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-c514b27a-9001-4455-9d3b-af5dda3ba7bb tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee" status: 404 len: 111 microversion: 2.1 time: 0.030496 Jul 14 11:53:50.097359 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 541/1034] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:50 2022] GET /compute/v2.1/servers/e820f5db-08dd-4219-809f-1d19d72cddee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:53:50.140187 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1235685688", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "networks": [{"uuid": "b461a243-e81b-4dc6-aba3-95839533f8ad"}]}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:53:50.194380 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.network.neutron [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] validate_networks() for [('b461a243-e81b-4dc6-aba3-95839533f8ad', None, None, None, None, None)] {{(pid=124946) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:53:50.538358 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Flavor limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:53:50.538780 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Image limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:53:50.539252 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Flavor pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:53:50.539668 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Image pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:53:50.540080 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:53:50.550069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:50.550516 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:50.551328 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:50.551761 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:50.568432 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Getting quotas for project e9905cd8264640fc99e83d869129d85a. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:53:50.572334 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Getting quotas for user 485159da9ec14f44b398c3cc618d3d84 and project e9905cd8264640fc99e83d869129d85a. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:53:50.583345 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Going to run 1 instances... {{(pid=124946) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:53:50.585658 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124946) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:53:50.705202 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-74da2164-af69-48ef-9c98-61ed959aaf8d tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569319 Jul 14 11:53:50.705860 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 494/1035] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:53:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:53:50.717640 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a8650927-e239-43b1-9494-e8165cfad37a tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:50.718432 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a8650927-e239-43b1-9494-e8165cfad37a tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:50.781016 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a8650927-e239-43b1-9494-e8165cfad37a tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:50.787707 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a8650927-e239-43b1-9494-e8165cfad37a tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 200 len: 1214 microversion: 2.1 time: 0.075405 Jul 14 11:53:50.788264 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 542/1036] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:50 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:51.804941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-63a4f800-5354-4e3d-9712-cc7ed8d24185 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:51.805597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-63a4f800-5354-4e3d-9712-cc7ed8d24185 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:51.811982 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-63a4f800-5354-4e3d-9712-cc7ed8d24185 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:51.812426 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-63a4f800-5354-4e3d-9712-cc7ed8d24185 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:51.813225 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-63a4f800-5354-4e3d-9712-cc7ed8d24185 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:51.813665 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-63a4f800-5354-4e3d-9712-cc7ed8d24185 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:51.879609 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-63a4f800-5354-4e3d-9712-cc7ed8d24185 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:51.888381 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-63a4f800-5354-4e3d-9712-cc7ed8d24185 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 200 len: 1210 microversion: 2.1 time: 0.087290 Jul 14 11:53:51.889214 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 495/1037] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:51 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:52.904832 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1a635f2d-bf1f-4b17-aa9d-d788f5c58d30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:52.905597 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1a635f2d-bf1f-4b17-aa9d-d788f5c58d30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:52.912954 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1a635f2d-bf1f-4b17-aa9d-d788f5c58d30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:52.913429 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1a635f2d-bf1f-4b17-aa9d-d788f5c58d30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:52.914196 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1a635f2d-bf1f-4b17-aa9d-d788f5c58d30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:52.914631 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1a635f2d-bf1f-4b17-aa9d-d788f5c58d30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:53.005142 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1a635f2d-bf1f-4b17-aa9d-d788f5c58d30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:53.013135 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1a635f2d-bf1f-4b17-aa9d-d788f5c58d30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 200 len: 1272 microversion: 2.1 time: 0.111588 Jul 14 11:53:53.013765 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 543/1038] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:52 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:54.031418 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-cbb1c8a2-b9f6-4341-9596-a5d10507661f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:54.032276 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-cbb1c8a2-b9f6-4341-9596-a5d10507661f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:54.039053 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cbb1c8a2-b9f6-4341-9596-a5d10507661f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:54.039500 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cbb1c8a2-b9f6-4341-9596-a5d10507661f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:54.040506 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cbb1c8a2-b9f6-4341-9596-a5d10507661f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:54.040942 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cbb1c8a2-b9f6-4341-9596-a5d10507661f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:54.180763 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-cbb1c8a2-b9f6-4341-9596-a5d10507661f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:54.189223 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-cbb1c8a2-b9f6-4341-9596-a5d10507661f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 200 len: 1314 microversion: 2.1 time: 0.161845 Jul 14 11:53:54.190227 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 496/1039] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:54 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:54.453704 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-afb4fc9c-eb87-4e6c-af63-90019193b2b3 req-ebc3928e-cf09-4632-9e76-96d1cf85b152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae23dc73-084b-4b07-bc26-a0651dbcea23", "tag": "9cb43317-38d8-45e9-909d-cf4bdf83695c"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:53:54.462462 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-afb4fc9c-eb87-4e6c-af63-90019193b2b3 req-ebc3928e-cf09-4632-9e76-96d1cf85b152 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:54.463812 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-afb4fc9c-eb87-4e6c-af63-90019193b2b3 req-ebc3928e-cf09-4632-9e76-96d1cf85b152 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:54.475573 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-afb4fc9c-eb87-4e6c-af63-90019193b2b3 req-ebc3928e-cf09-4632-9e76-96d1cf85b152 service nova] Creating event network-changed:9cb43317-38d8-45e9-909d-cf4bdf83695c for instance ae23dc73-084b-4b07-bc26-a0651dbcea23 on hv-cinder-84980 Jul 14 11:53:54.480399 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-afb4fc9c-eb87-4e6c-af63-90019193b2b3 req-ebc3928e-cf09-4632-9e76-96d1cf85b152 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031629 Jul 14 11:53:54.480985 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 544/1040] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:53:55.206821 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d1dc7b13-7579-47ea-880e-200b28b26634 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:55.207526 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d1dc7b13-7579-47ea-880e-200b28b26634 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:55.214136 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d1dc7b13-7579-47ea-880e-200b28b26634 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:55.214637 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d1dc7b13-7579-47ea-880e-200b28b26634 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:55.215392 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d1dc7b13-7579-47ea-880e-200b28b26634 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:55.215878 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d1dc7b13-7579-47ea-880e-200b28b26634 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:55.349569 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d1dc7b13-7579-47ea-880e-200b28b26634 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:55.357871 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d1dc7b13-7579-47ea-880e-200b28b26634 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 200 len: 1314 microversion: 2.1 time: 0.154984 Jul 14 11:53:55.358452 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 497/1041] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:55 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:56.375679 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-2bfb5a6e-64f4-4ae9-a4a5-02ea154fe9d8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:56.376386 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-2bfb5a6e-64f4-4ae9-a4a5-02ea154fe9d8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:56.382701 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2bfb5a6e-64f4-4ae9-a4a5-02ea154fe9d8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:56.383150 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2bfb5a6e-64f4-4ae9-a4a5-02ea154fe9d8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:56.383923 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2bfb5a6e-64f4-4ae9-a4a5-02ea154fe9d8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:56.384364 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-2bfb5a6e-64f4-4ae9-a4a5-02ea154fe9d8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:56.517389 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-2bfb5a6e-64f4-4ae9-a4a5-02ea154fe9d8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:56.525121 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-2bfb5a6e-64f4-4ae9-a4a5-02ea154fe9d8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 200 len: 1314 microversion: 2.1 time: 0.154257 Jul 14 11:53:56.525711 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 545/1042] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:56 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:57.541802 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9e6b0db9-bc85-48b3-ac40-5d82654f3756 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:57.542433 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9e6b0db9-bc85-48b3-ac40-5d82654f3756 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:57.549011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9e6b0db9-bc85-48b3-ac40-5d82654f3756 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:57.549494 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9e6b0db9-bc85-48b3-ac40-5d82654f3756 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:57.550261 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9e6b0db9-bc85-48b3-ac40-5d82654f3756 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:57.550785 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9e6b0db9-bc85-48b3-ac40-5d82654f3756 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:57.680300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-9e6b0db9-bc85-48b3-ac40-5d82654f3756 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:57.692236 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9e6b0db9-bc85-48b3-ac40-5d82654f3756 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 200 len: 1314 microversion: 2.1 time: 0.154288 Jul 14 11:53:57.692821 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 498/1043] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:57 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:58.708197 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-fee4156b-edeb-4e87-9c11-37e209fc7c30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:58.709126 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-fee4156b-edeb-4e87-9c11-37e209fc7c30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:58.715296 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fee4156b-edeb-4e87-9c11-37e209fc7c30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:58.715820 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fee4156b-edeb-4e87-9c11-37e209fc7c30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:58.716702 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fee4156b-edeb-4e87-9c11-37e209fc7c30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:58.717140 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-fee4156b-edeb-4e87-9c11-37e209fc7c30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:58.851448 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-fee4156b-edeb-4e87-9c11-37e209fc7c30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:53:58.859006 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-fee4156b-edeb-4e87-9c11-37e209fc7c30 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 200 len: 1314 microversion: 2.1 time: 0.154626 Jul 14 11:53:58.859583 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 546/1044] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:58 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:53:59.875893 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-3832aecf-0d8a-4d99-aaca-e95f739ddf45 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:53:59.876464 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-3832aecf-0d8a-4d99-aaca-e95f739ddf45 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:53:59.883411 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3832aecf-0d8a-4d99-aaca-e95f739ddf45 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:59.883866 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3832aecf-0d8a-4d99-aaca-e95f739ddf45 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:53:59.884641 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3832aecf-0d8a-4d99-aaca-e95f739ddf45 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:53:59.885089 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-3832aecf-0d8a-4d99-aaca-e95f739ddf45 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:00.014600 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-3832aecf-0d8a-4d99-aaca-e95f739ddf45 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:00.022272 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-3832aecf-0d8a-4d99-aaca-e95f739ddf45 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 200 len: 1314 microversion: 2.1 time: 0.150287 Jul 14 11:54:00.022836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 499/1045] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:53:59 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:01.040720 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6cef57eb-3d96-4ac1-bec2-69940899c54f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:01.041405 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6cef57eb-3d96-4ac1-bec2-69940899c54f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:01.044094 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:01.051469 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6cef57eb-3d96-4ac1-bec2-69940899c54f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:01.052315 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6cef57eb-3d96-4ac1-bec2-69940899c54f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:01.053627 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6cef57eb-3d96-4ac1-bec2-69940899c54f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:01.054079 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6cef57eb-3d96-4ac1-bec2-69940899c54f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:01.197224 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6cef57eb-3d96-4ac1-bec2-69940899c54f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:01.202813 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-53872b19-8da7-4464-ab43-4900fb179f6c req-4dcf5d04-2fb8-4f61-b2ed-62243c0f7e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae23dc73-084b-4b07-bc26-a0651dbcea23", "name": "network-vif-plugged", "status": "completed", "tag": "9cb43317-38d8-45e9-909d-cf4bdf83695c"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:54:01.206141 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6cef57eb-3d96-4ac1-bec2-69940899c54f tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 200 len: 1314 microversion: 2.1 time: 0.170142 Jul 14 11:54:01.207195 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 547/1046] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:01 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:01.209265 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:01.209492 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=6 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:01.214458 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-53872b19-8da7-4464-ab43-4900fb179f6c req-4dcf5d04-2fb8-4f61-b2ed-62243c0f7e10 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:01.216203 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-53872b19-8da7-4464-ab43-4900fb179f6c req-4dcf5d04-2fb8-4f61-b2ed-62243c0f7e10 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:01.227259 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-53872b19-8da7-4464-ab43-4900fb179f6c req-4dcf5d04-2fb8-4f61-b2ed-62243c0f7e10 service nova] Creating event network-vif-plugged:9cb43317-38d8-45e9-909d-cf4bdf83695c for instance ae23dc73-084b-4b07-bc26-a0651dbcea23 on hv-cinder-84980 Jul 14 11:54:01.233070 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-53872b19-8da7-4464-ab43-4900fb179f6c req-4dcf5d04-2fb8-4f61-b2ed-62243c0f7e10 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033523 Jul 14 11:54:01.233915 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 500/1047] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:54:02.223000 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-754ce952-f3a4-4972-882d-d47cf8641907 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:02.223865 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-754ce952-f3a4-4972-882d-d47cf8641907 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:02.227664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:02.236626 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-754ce952-f3a4-4972-882d-d47cf8641907 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:02.237435 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-754ce952-f3a4-4972-882d-d47cf8641907 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:02.238480 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-754ce952-f3a4-4972-882d-d47cf8641907 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:02.238948 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-754ce952-f3a4-4972-882d-d47cf8641907 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:02.241755 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=81 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:02.372273 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-754ce952-f3a4-4972-882d-d47cf8641907 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:02.380577 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-754ce952-f3a4-4972-882d-d47cf8641907 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 200 len: 1314 microversion: 2.1 time: 0.161510 Jul 14 11:54:02.381143 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 548/1048] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:02 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:03.398664 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d7d11b68-157a-4bb9-b856-9e4b0e13b875 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:03.399365 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d7d11b68-157a-4bb9-b856-9e4b0e13b875 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:03.401663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:03.407380 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d7d11b68-157a-4bb9-b856-9e4b0e13b875 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:03.407830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d7d11b68-157a-4bb9-b856-9e4b0e13b875 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:03.408634 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d7d11b68-157a-4bb9-b856-9e4b0e13b875 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:03.409302 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d7d11b68-157a-4bb9-b856-9e4b0e13b875 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:03.421911 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:03.546991 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d7d11b68-157a-4bb9-b856-9e4b0e13b875 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:03.548498 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d7d11b68-157a-4bb9-b856-9e4b0e13b875 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 200 len: 1498 microversion: 2.1 time: 0.154593 Jul 14 11:54:03.549073 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 501/1049] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:03 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:04.255881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-055c995b-b67c-4de1-bd46-ad4d8cbadeb3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:04.256440 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-055c995b-b67c-4de1-bd46-ad4d8cbadeb3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:04.262939 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-055c995b-b67c-4de1-bd46-ad4d8cbadeb3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:04.263380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-055c995b-b67c-4de1-bd46-ad4d8cbadeb3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:04.264134 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-055c995b-b67c-4de1-bd46-ad4d8cbadeb3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:04.264563 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-055c995b-b67c-4de1-bd46-ad4d8cbadeb3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:04.289918 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-055c995b-b67c-4de1-bd46-ad4d8cbadeb3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Going to try to terminate instance {{(pid=124947) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:54:04.634556 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-055c995b-b67c-4de1-bd46-ad4d8cbadeb3 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 204 len: 0 microversion: 2.1 time: 0.382319 Jul 14 11:54:04.635165 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 549/1050] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:54:04 2022] DELETE /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:04.644169 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d75412c5-a556-4573-9335-53e77e223c98 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:04.644775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d75412c5-a556-4573-9335-53e77e223c98 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:04.652601 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d75412c5-a556-4573-9335-53e77e223c98 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:04.653042 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d75412c5-a556-4573-9335-53e77e223c98 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:04.653824 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d75412c5-a556-4573-9335-53e77e223c98 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:04.654252 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d75412c5-a556-4573-9335-53e77e223c98 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:04.787356 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d75412c5-a556-4573-9335-53e77e223c98 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:04.794920 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d75412c5-a556-4573-9335-53e77e223c98 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 200 len: 1504 microversion: 2.1 time: 0.155273 Jul 14 11:54:04.795511 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 502/1051] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:04 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:05.813085 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-760eb736-ab05-4f1a-aa50-ebe86c3a0295 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:05.813858 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-760eb736-ab05-4f1a-aa50-ebe86c3a0295 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:05.820399 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-760eb736-ab05-4f1a-aa50-ebe86c3a0295 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:05.820851 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-760eb736-ab05-4f1a-aa50-ebe86c3a0295 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:05.821679 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-760eb736-ab05-4f1a-aa50-ebe86c3a0295 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:05.822113 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-760eb736-ab05-4f1a-aa50-ebe86c3a0295 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:06.011998 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-760eb736-ab05-4f1a-aa50-ebe86c3a0295 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:06.020213 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-760eb736-ab05-4f1a-aa50-ebe86c3a0295 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 200 len: 1504 microversion: 2.1 time: 0.211866 Jul 14 11:54:06.020807 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 550/1052] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:05 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:06.793676 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-38ed2fd8-aaa3-4edb-940c-56b962c042f3 req-1ef99cd5-d72f-469f-a48d-e138bdd45bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae23dc73-084b-4b07-bc26-a0651dbcea23", "name": "network-vif-deleted", "tag": "9cb43317-38d8-45e9-909d-cf4bdf83695c"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:54:06.802640 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-38ed2fd8-aaa3-4edb-940c-56b962c042f3 req-1ef99cd5-d72f-469f-a48d-e138bdd45bac service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:06.803069 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-38ed2fd8-aaa3-4edb-940c-56b962c042f3 req-1ef99cd5-d72f-469f-a48d-e138bdd45bac service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:06.819147 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-38ed2fd8-aaa3-4edb-940c-56b962c042f3 req-1ef99cd5-d72f-469f-a48d-e138bdd45bac service nova] Creating event network-vif-deleted:9cb43317-38d8-45e9-909d-cf4bdf83695c for instance ae23dc73-084b-4b07-bc26-a0651dbcea23 on hv-cinder-84980 Jul 14 11:54:06.819147 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-38ed2fd8-aaa3-4edb-940c-56b962c042f3 req-1ef99cd5-d72f-469f-a48d-e138bdd45bac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029124 Jul 14 11:54:06.819690 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 503/1053] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:54:07.037017 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5c160bc3-179c-45ed-b7fa-9b9c46ce309e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:07.037695 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-5c160bc3-179c-45ed-b7fa-9b9c46ce309e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:07.044189 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5c160bc3-179c-45ed-b7fa-9b9c46ce309e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:07.044632 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5c160bc3-179c-45ed-b7fa-9b9c46ce309e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:07.045419 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5c160bc3-179c-45ed-b7fa-9b9c46ce309e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:07.045882 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5c160bc3-179c-45ed-b7fa-9b9c46ce309e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:07.111445 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-5c160bc3-179c-45ed-b7fa-9b9c46ce309e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485159da9ec14f44b398c3cc618d3d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9905cd8264640fc99e83d869129d85a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:07.118860 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-5c160bc3-179c-45ed-b7fa-9b9c46ce309e tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 200 len: 1299 microversion: 2.1 time: 0.085651 Jul 14 11:54:07.119451 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 551/1054] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:07 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:08.137646 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9453dba3-9ed7-47e4-8b2f-6ef0967dedd8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:08.138268 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9453dba3-9ed7-47e4-8b2f-6ef0967dedd8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] [instance: ae23dc73-084b-4b07-bc26-a0651dbcea23] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:08.144819 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9453dba3-9ed7-47e4-8b2f-6ef0967dedd8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:08.145282 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9453dba3-9ed7-47e4-8b2f-6ef0967dedd8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:08.146058 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9453dba3-9ed7-47e4-8b2f-6ef0967dedd8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:08.146498 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9453dba3-9ed7-47e4-8b2f-6ef0967dedd8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:08.159549 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-9453dba3-9ed7-47e4-8b2f-6ef0967dedd8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] HTTP exception thrown: Instance ae23dc73-084b-4b07-bc26-a0651dbcea23 could not be found. Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9453dba3-9ed7-47e4-8b2f-6ef0967dedd8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Request method failure captured: Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 HTTP/1.1 Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0AO59877sE_5zl2vK8t6qBIm8BlEhdfPIj6etDKV4_9Q8CgFKzOR6-VTdP-S-l02VLeQhJDigglc8J1-X95a31TIDVciF2zq-Lp1rl_4IgsKtsJgOtmGEM8O95pfoHTTpXS0wGV0aBKe3GC2IdAC_G7zklCvvhj_cwX9yInJUfEgJtE Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: e9905cd8264640fc99e83d869129d85a Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-VolumesActionsTest-19856136 Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:54:08.161242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:54:08.162775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e9905cd8264640fc99e83d869129d85a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e9905cd8264640fc99e83d869129d85a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e9905cd8264640fc99e83d869129d85a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e9905cd8264640fc99e83d869129d85a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:54:08.162775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-VolumesActionsTest-19856136 Jul 14 11:54:08.162775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: e9905cd8264640fc99e83d869129d85a Jul 14 11:54:08.162775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-VolumesActionsTest-19856136 Jul 14 11:54:08.162775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-VolumesActionsTest-19856136-project Jul 14 11:54:08.162775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:54:08.162775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:54:08.162775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 485159da9ec14f44b398c3cc618d3d84 Jul 14 11:54:08.162775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-VolumesActionsTest-19856136-project Jul 14 11:54:08.162775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:54:08.162775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance ae23dc73-084b-4b07-bc26-a0651dbcea23 could not be found. Jul 14 11:54:08.162775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': 'ae23dc73-084b-4b07-bc26-a0651dbcea23'} Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae23dc73-084b-4b07-bc26-a0651dbcea23 could not be found. Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:54:08.163620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae23dc73-084b-4b07-bc26-a0651dbcea23 could not be found. Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae23dc73-084b-4b07-bc26-a0651dbcea23 could not be found. Jul 14 11:54:08.165390 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:54:08.166791 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9453dba3-9ed7-47e4-8b2f-6ef0967dedd8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] Returning 404 to user: Instance ae23dc73-084b-4b07-bc26-a0651dbcea23 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:54:08.166791 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9453dba3-9ed7-47e4-8b2f-6ef0967dedd8 tempest-VolumesActionsTest-19856136 tempest-VolumesActionsTest-19856136-project] 10.222.0.40 "GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23" status: 404 len: 111 microversion: 2.1 time: 0.030220 Jul 14 11:54:08.166791 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 504/1055] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:08 2022] GET /compute/v2.1/servers/ae23dc73-084b-4b07-bc26-a0651dbcea23 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:54:10.713792 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:54:10.714381 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Thu Jul 14 11:54:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:54:38.950590 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1682943955", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "networks": [{"uuid": "d934d39c-6d41-4a49-a5c1-23132bb43486"}]}} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:54:38.958011 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:38.958676 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:39.210444 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.network.neutron [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] validate_networks() for [('d934d39c-6d41-4a49-a5c1-23132bb43486', None, None, None, None, None)] {{(pid=124947) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:54:39.567696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Flavor limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:54:39.568111 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Image limits 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:54:39.568617 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Flavor pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:54:39.569095 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Image pref 0:0:0 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:54:39.569550 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.virt.hardware [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:54:39.578471 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:39.578855 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:39.580445 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:39.580883 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:39.597889 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Getting quotas for project 81884daddee04f478f047f2c309ad433. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:54:39.601950 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.quota [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Getting quotas for user d282558617e24bcdb1bf6bddbab7cddd and project 81884daddee04f478f047f2c309ad433. Resources: {'ram', 'instances', 'cores'} {{(pid=124947) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:54:39.612852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Going to run 1 instances... {{(pid=124947) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:54:39.615122 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:54:39.802018 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-63fd03ca-09e5-427e-8464-a7bea0a07cc8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.855203 Jul 14 11:54:39.803487 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 552/1056] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:54:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:54:39.812967 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-1698aa94-4285-4b30-8273-e27126b61e01 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:39.813626 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-1698aa94-4285-4b30-8273-e27126b61e01 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:39.816538 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=7 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:39.817271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=15 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:39.933063 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-1698aa94-4285-4b30-8273-e27126b61e01 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:39.941059 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-1698aa94-4285-4b30-8273-e27126b61e01 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 200 len: 1219 microversion: 2.1 time: 0.132261 Jul 14 11:54:39.941658 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 505/1057] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:39 2022] GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:40.958681 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9cdbde9e-7b45-4f1f-93d4-5ce9340126a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:40.959330 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9cdbde9e-7b45-4f1f-93d4-5ce9340126a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:40.966377 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cdbde9e-7b45-4f1f-93d4-5ce9340126a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:40.966827 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cdbde9e-7b45-4f1f-93d4-5ce9340126a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:40.967598 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cdbde9e-7b45-4f1f-93d4-5ce9340126a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:40.968039 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9cdbde9e-7b45-4f1f-93d4-5ce9340126a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:41.033601 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9cdbde9e-7b45-4f1f-93d4-5ce9340126a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:41.042787 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9cdbde9e-7b45-4f1f-93d4-5ce9340126a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 200 len: 1223 microversion: 2.1 time: 0.088763 Jul 14 11:54:41.043797 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 553/1058] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:40 2022] GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:42.060026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ba596da4-de89-4643-8781-847c03183bd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:42.060634 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ba596da4-de89-4643-8781-847c03183bd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:42.068228 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba596da4-de89-4643-8781-847c03183bd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:42.078152 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba596da4-de89-4643-8781-847c03183bd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:42.078152 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba596da4-de89-4643-8781-847c03183bd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:42.078152 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ba596da4-de89-4643-8781-847c03183bd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:42.142120 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ba596da4-de89-4643-8781-847c03183bd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:42.151229 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ba596da4-de89-4643-8781-847c03183bd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 200 len: 1279 microversion: 2.1 time: 0.095009 Jul 14 11:54:42.151822 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 506/1059] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:42 2022] GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:43.169334 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-38b204d6-f910-4cd1-a9a6-fcd2272f918c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:43.170684 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-38b204d6-f910-4cd1-a9a6-fcd2272f918c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:43.177700 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-38b204d6-f910-4cd1-a9a6-fcd2272f918c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:43.178145 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-38b204d6-f910-4cd1-a9a6-fcd2272f918c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:43.178909 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-38b204d6-f910-4cd1-a9a6-fcd2272f918c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:43.179337 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-38b204d6-f910-4cd1-a9a6-fcd2272f918c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:43.313763 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-38b204d6-f910-4cd1-a9a6-fcd2272f918c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:43.322430 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-38b204d6-f910-4cd1-a9a6-fcd2272f918c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 200 len: 1319 microversion: 2.1 time: 0.156994 Jul 14 11:54:43.323440 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 554/1060] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:43 2022] GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:43.665874 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-92c924e6-84a6-4fed-9198-6310758f5dcb req-9b2ec9f2-3420-436f-a5c3-dd64197a5c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f1e8e0d-5efe-4abd-8940-06d3c154b397", "tag": "9394448b-942f-4bd9-aa79-84b4f556a19a"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:54:43.678709 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-92c924e6-84a6-4fed-9198-6310758f5dcb req-9b2ec9f2-3420-436f-a5c3-dd64197a5c1a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:43.678709 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-92c924e6-84a6-4fed-9198-6310758f5dcb req-9b2ec9f2-3420-436f-a5c3-dd64197a5c1a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:43.687565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-92c924e6-84a6-4fed-9198-6310758f5dcb req-9b2ec9f2-3420-436f-a5c3-dd64197a5c1a service nova] Creating event network-changed:9394448b-942f-4bd9-aa79-84b4f556a19a for instance 7f1e8e0d-5efe-4abd-8940-06d3c154b397 on hv-cinder-84980 Jul 14 11:54:43.692616 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-92c924e6-84a6-4fed-9198-6310758f5dcb req-9b2ec9f2-3420-436f-a5c3-dd64197a5c1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030564 Jul 14 11:54:43.693437 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 507/1061] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:54:44.339849 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f404b962-c872-4be1-ba2c-10ef99c2ddfe tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:44.340386 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f404b962-c872-4be1-ba2c-10ef99c2ddfe tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:44.347473 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f404b962-c872-4be1-ba2c-10ef99c2ddfe tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:44.347932 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f404b962-c872-4be1-ba2c-10ef99c2ddfe tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:44.348708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f404b962-c872-4be1-ba2c-10ef99c2ddfe tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:44.349147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f404b962-c872-4be1-ba2c-10ef99c2ddfe tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:44.482290 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f404b962-c872-4be1-ba2c-10ef99c2ddfe tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:44.490332 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f404b962-c872-4be1-ba2c-10ef99c2ddfe tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 200 len: 1319 microversion: 2.1 time: 0.154459 Jul 14 11:54:44.490907 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 555/1062] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:44 2022] GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:45.508408 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-02fa8b2d-529e-4034-aa04-61792a245b75 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:45.509132 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-02fa8b2d-529e-4034-aa04-61792a245b75 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:45.515890 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-02fa8b2d-529e-4034-aa04-61792a245b75 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:45.516356 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-02fa8b2d-529e-4034-aa04-61792a245b75 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:45.517394 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-02fa8b2d-529e-4034-aa04-61792a245b75 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:45.517855 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-02fa8b2d-529e-4034-aa04-61792a245b75 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:45.650871 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-02fa8b2d-529e-4034-aa04-61792a245b75 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:45.658336 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-02fa8b2d-529e-4034-aa04-61792a245b75 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 200 len: 1319 microversion: 2.1 time: 0.154453 Jul 14 11:54:45.658898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 508/1063] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:45 2022] GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:46.675098 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-bdde20d9-344c-41b9-afce-7a43439b9f8f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:46.675717 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-bdde20d9-344c-41b9-afce-7a43439b9f8f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:46.682218 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bdde20d9-344c-41b9-afce-7a43439b9f8f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:46.682675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bdde20d9-344c-41b9-afce-7a43439b9f8f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:46.683442 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bdde20d9-344c-41b9-afce-7a43439b9f8f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:46.683881 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-bdde20d9-344c-41b9-afce-7a43439b9f8f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:46.810898 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-bdde20d9-344c-41b9-afce-7a43439b9f8f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:46.818819 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-bdde20d9-344c-41b9-afce-7a43439b9f8f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 200 len: 1319 microversion: 2.1 time: 0.147625 Jul 14 11:54:46.819376 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 556/1064] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:46 2022] GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:54:47.835875 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-37dc9a9b-f1ad-4ec7-8cb4-78dc0142d8b1 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:47.836571 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-37dc9a9b-f1ad-4ec7-8cb4-78dc0142d8b1 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:47.843642 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-37dc9a9b-f1ad-4ec7-8cb4-78dc0142d8b1 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:47.844090 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-37dc9a9b-f1ad-4ec7-8cb4-78dc0142d8b1 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:47.844862 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-37dc9a9b-f1ad-4ec7-8cb4-78dc0142d8b1 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:47.845331 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-37dc9a9b-f1ad-4ec7-8cb4-78dc0142d8b1 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:47.973839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-37dc9a9b-f1ad-4ec7-8cb4-78dc0142d8b1 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:47.981332 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-37dc9a9b-f1ad-4ec7-8cb4-78dc0142d8b1 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 200 len: 1319 microversion: 2.1 time: 0.149272 Jul 14 11:54:47.981903 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 509/1065] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:47 2022] GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:48.998519 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-316e86d2-e25d-4a91-a754-47f17c1b150c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:48.999121 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-316e86d2-e25d-4a91-a754-47f17c1b150c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:49.007482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-316e86d2-e25d-4a91-a754-47f17c1b150c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:49.008568 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-316e86d2-e25d-4a91-a754-47f17c1b150c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:49.010136 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-316e86d2-e25d-4a91-a754-47f17c1b150c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:49.011123 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-316e86d2-e25d-4a91-a754-47f17c1b150c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:49.141935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-316e86d2-e25d-4a91-a754-47f17c1b150c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:49.149330 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-316e86d2-e25d-4a91-a754-47f17c1b150c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 200 len: 1319 microversion: 2.1 time: 0.154621 Jul 14 11:54:49.149961 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 557/1066] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:48 2022] GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:49.455323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-7142d954-5711-43b9-b319-c92a590ae654 req-1f65d20c-c9d2-4544-8469-bbc5fba76b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1e8e0d-5efe-4abd-8940-06d3c154b397", "name": "network-vif-plugged", "status": "completed", "tag": "9394448b-942f-4bd9-aa79-84b4f556a19a"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:54:49.463611 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-7142d954-5711-43b9-b319-c92a590ae654 req-1f65d20c-c9d2-4544-8469-bbc5fba76b18 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:49.464059 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-7142d954-5711-43b9-b319-c92a590ae654 req-1f65d20c-c9d2-4544-8469-bbc5fba76b18 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:49.476388 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-7142d954-5711-43b9-b319-c92a590ae654 req-1f65d20c-c9d2-4544-8469-bbc5fba76b18 service nova] Creating event network-vif-plugged:9394448b-942f-4bd9-aa79-84b4f556a19a for instance 7f1e8e0d-5efe-4abd-8940-06d3c154b397 on hv-cinder-84980 Jul 14 11:54:49.481080 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-7142d954-5711-43b9-b319-c92a590ae654 req-1f65d20c-c9d2-4544-8469-bbc5fba76b18 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091971 Jul 14 11:54:49.482231 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 510/1067] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:54:50.166780 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-4fa2518e-df74-4b41-8622-0848b262ba09 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:50.167391 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-4fa2518e-df74-4b41-8622-0848b262ba09 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:50.169237 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:50.169886 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=6 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:50.175621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4fa2518e-df74-4b41-8622-0848b262ba09 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:50.176067 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4fa2518e-df74-4b41-8622-0848b262ba09 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:50.176822 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4fa2518e-df74-4b41-8622-0848b262ba09 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:50.177282 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-4fa2518e-df74-4b41-8622-0848b262ba09 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:50.368371 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-4fa2518e-df74-4b41-8622-0848b262ba09 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:50.375970 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-4fa2518e-df74-4b41-8622-0848b262ba09 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 200 len: 1319 microversion: 2.1 time: 0.213080 Jul 14 11:54:50.378487 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 558/1068] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:50 2022] GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:51.394145 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-21cb7757-7696-4f89-bbe5-ebf72947fd32 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:51.394767 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-21cb7757-7696-4f89-bbe5-ebf72947fd32 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:51.396788 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:54:51.402960 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-21cb7757-7696-4f89-bbe5-ebf72947fd32 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:51.406172 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-21cb7757-7696-4f89-bbe5-ebf72947fd32 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:51.406172 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-21cb7757-7696-4f89-bbe5-ebf72947fd32 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:51.406172 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-21cb7757-7696-4f89-bbe5-ebf72947fd32 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:51.541953 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-21cb7757-7696-4f89-bbe5-ebf72947fd32 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:51.549812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-21cb7757-7696-4f89-bbe5-ebf72947fd32 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 200 len: 1508 microversion: 2.1 time: 0.160251 Jul 14 11:54:51.550382 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 511/1069] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:51 2022] GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:52.644721 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8fbd2b3e-6d86-4900-9e4c-db67eb2a43a5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:52.645273 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-8fbd2b3e-6d86-4900-9e4c-db67eb2a43a5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:52.655175 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8fbd2b3e-6d86-4900-9e4c-db67eb2a43a5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:52.656084 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8fbd2b3e-6d86-4900-9e4c-db67eb2a43a5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:52.657897 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8fbd2b3e-6d86-4900-9e4c-db67eb2a43a5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:52.658710 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8fbd2b3e-6d86-4900-9e4c-db67eb2a43a5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:52.686831 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-8fbd2b3e-6d86-4900-9e4c-db67eb2a43a5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Going to try to terminate instance {{(pid=124947) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:54:52.977283 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-8fbd2b3e-6d86-4900-9e4c-db67eb2a43a5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 204 len: 0 microversion: 2.1 time: 0.337274 Jul 14 11:54:52.977949 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 559/1070] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:54:52 2022] DELETE /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:54:52.987136 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6ea8b140-243a-40b9-8e55-da7fee9e17f4 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:52.987819 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6ea8b140-243a-40b9-8e55-da7fee9e17f4 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:52.994771 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6ea8b140-243a-40b9-8e55-da7fee9e17f4 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:52.995225 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6ea8b140-243a-40b9-8e55-da7fee9e17f4 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:52.996011 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6ea8b140-243a-40b9-8e55-da7fee9e17f4 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:52.996448 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6ea8b140-243a-40b9-8e55-da7fee9e17f4 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:53.138648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6ea8b140-243a-40b9-8e55-da7fee9e17f4 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:53.146668 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6ea8b140-243a-40b9-8e55-da7fee9e17f4 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1575 microversion: 2.1 time: 0.164023 Jul 14 11:54:53.147168 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 512/1071] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:52 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:54.164949 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a94fc319-919c-4ff2-a80d-d62968f590e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:54.165591 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a94fc319-919c-4ff2-a80d-d62968f590e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:54.173646 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a94fc319-919c-4ff2-a80d-d62968f590e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:54.174116 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a94fc319-919c-4ff2-a80d-d62968f590e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:54.174974 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a94fc319-919c-4ff2-a80d-d62968f590e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:54.175412 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a94fc319-919c-4ff2-a80d-d62968f590e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:54.312222 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a94fc319-919c-4ff2-a80d-d62968f590e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:54.319892 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a94fc319-919c-4ff2-a80d-d62968f590e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1575 microversion: 2.1 time: 0.159408 Jul 14 11:54:54.320466 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 560/1072] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:54 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:55.402830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ef1910ac-5f71-4452-be89-cae5cfd44ed9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:55.402830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ef1910ac-5f71-4452-be89-cae5cfd44ed9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:55.402830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ef1910ac-5f71-4452-be89-cae5cfd44ed9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:55.402830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ef1910ac-5f71-4452-be89-cae5cfd44ed9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:55.406255 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ef1910ac-5f71-4452-be89-cae5cfd44ed9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:55.406255 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ef1910ac-5f71-4452-be89-cae5cfd44ed9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:55.494220 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ef1910ac-5f71-4452-be89-cae5cfd44ed9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:55.501868 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ef1910ac-5f71-4452-be89-cae5cfd44ed9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1575 microversion: 2.1 time: 0.167972 Jul 14 11:54:55.503109 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 513/1073] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:55 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:56.036835 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-901beff7-4534-404d-9cee-d01ff8288c5a req-cc681848-25ca-41d7-aba6-b3260e07122a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec7809b-bc37-4ba9-9481-743c85a10de8", "name": "network-vif-deleted", "tag": "13845ba0-8394-4994-8f3a-c990a6595f50"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:54:56.045649 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-901beff7-4534-404d-9cee-d01ff8288c5a req-cc681848-25ca-41d7-aba6-b3260e07122a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:56.051956 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-901beff7-4534-404d-9cee-d01ff8288c5a req-cc681848-25ca-41d7-aba6-b3260e07122a service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:56.058808 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-901beff7-4534-404d-9cee-d01ff8288c5a req-cc681848-25ca-41d7-aba6-b3260e07122a service nova] Creating event network-vif-deleted:13845ba0-8394-4994-8f3a-c990a6595f50 for instance cec7809b-bc37-4ba9-9481-743c85a10de8 on hv-cinder-84980 Jul 14 11:54:56.067514 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-901beff7-4534-404d-9cee-d01ff8288c5a req-cc681848-25ca-41d7-aba6-b3260e07122a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034452 Jul 14 11:54:56.068445 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 561/1074] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:54:56.520840 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b657e857-fb05-4d83-8a2f-c81e81562c81 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:56.521628 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b657e857-fb05-4d83-8a2f-c81e81562c81 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:56.529079 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b657e857-fb05-4d83-8a2f-c81e81562c81 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:56.536421 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b657e857-fb05-4d83-8a2f-c81e81562c81 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:56.536421 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b657e857-fb05-4d83-8a2f-c81e81562c81 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:56.536421 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b657e857-fb05-4d83-8a2f-c81e81562c81 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:56.605905 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b657e857-fb05-4d83-8a2f-c81e81562c81 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:56.614831 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b657e857-fb05-4d83-8a2f-c81e81562c81 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 200 len: 1224 microversion: 2.1 time: 0.098300 Jul 14 11:54:56.624253 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 514/1075] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:56 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:54:57.633593 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-be4f6b49-4d3f-4596-9cb7-f10a6f2bde84 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:57.634438 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-be4f6b49-4d3f-4596-9cb7-f10a6f2bde84 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:57.641353 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-be4f6b49-4d3f-4596-9cb7-f10a6f2bde84 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:57.642075 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-be4f6b49-4d3f-4596-9cb7-f10a6f2bde84 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:57.642930 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-be4f6b49-4d3f-4596-9cb7-f10a6f2bde84 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:57.643366 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-be4f6b49-4d3f-4596-9cb7-f10a6f2bde84 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:57.657076 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-be4f6b49-4d3f-4596-9cb7-f10a6f2bde84 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] HTTP exception thrown: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-be4f6b49-4d3f-4596-9cb7-f10a6f2bde84 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Request method failure captured: Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 HTTP/1.1 Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0ANCSdxumVbFxLq3MTUZvQsCwhVTkzXtYsq36ntRUdlb-1dTHQiUFv49SCoLzZJ5gnQyPDPMjaBT1935c1S8Nv4aAsSWwNHHF674DgwEGdVkEArzdjwfdBhGlgExlG1V9r1HKIgfh_ZTK6XOxEChtBS_rDbSG-A8Fo-azMEt1w2Sd_M Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 7119e46a06b54c2984b21f32d9c156e3 Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-TestVolumeBootPattern-810863928 Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:54:57.658752 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:54:57.660494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:54:57.660494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-TestVolumeBootPattern-810863928 Jul 14 11:54:57.660494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 7119e46a06b54c2984b21f32d9c156e3 Jul 14 11:54:57.660494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-TestVolumeBootPattern-810863928 Jul 14 11:54:57.660494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-TestVolumeBootPattern-810863928-project Jul 14 11:54:57.660494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:54:57.660494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:54:57.660494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 1a71cad9c9114c5cb0bf8b4fe982e4d5 Jul 14 11:54:57.660494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-TestVolumeBootPattern-810863928-project Jul 14 11:54:57.660494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:54:57.660494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. Jul 14 11:54:57.660494 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': 'cec7809b-bc37-4ba9-9481-743c85a10de8'} Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:54:57.661675 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. Jul 14 11:54:57.663322 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:54:57.664800 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-be4f6b49-4d3f-4596-9cb7-f10a6f2bde84 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Returning 404 to user: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:54:57.664800 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-be4f6b49-4d3f-4596-9cb7-f10a6f2bde84 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 404 len: 111 microversion: 2.1 time: 0.032095 Jul 14 11:54:57.664800 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 562/1076] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:57 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:54:57.755253 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1216317303", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-634704875", "security_groups": [{"name": "tempest-secgroup-smoke-630221934"}], "block_device_mapping_v2": [{"uuid": "cb88522f-02c9-4c67-a83e-875ce4990f10", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c22b4386-d3cd-4949-9a26-72cae23c6f3e"}]}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:54:57.871016 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.network.neutron [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] validate_networks() for [('c22b4386-d3cd-4949-9a26-72cae23c6f3e', None, None, None, None, None)] {{(pid=124946) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:54:58.304606 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Flavor limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:54:58.305026 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Image limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:54:58.305525 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Flavor pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:54:58.305930 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Image pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:54:58.306336 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:54:58.315146 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:58.315583 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:58.316372 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:58.316800 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:58.335172 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Getting quotas for project 7119e46a06b54c2984b21f32d9c156e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:54:58.339127 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Getting quotas for user 1a71cad9c9114c5cb0bf8b4fe982e4d5 and project 7119e46a06b54c2984b21f32d9c156e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:54:58.399803 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Going to run 1 instances... {{(pid=124946) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:54:58.401969 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb88522f-02c9-4c67-a83e-875ce4990f10',volume_size=None,volume_type=None)] {{(pid=124946) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:54:58.805480 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5e4a269d-3cc8-4ab8-9cb9-df8c515be3d0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.054030 Jul 14 11:54:58.809244 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 515/1077] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:54:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:54:58.816481 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ecc4f4f9-3978-47dc-b0ea-aeb2bb358f67 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:58.817086 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ecc4f4f9-3978-47dc-b0ea-aeb2bb358f67 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:58.874681 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-ecc4f4f9-3978-47dc-b0ea-aeb2bb358f67 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:58.882125 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ecc4f4f9-3978-47dc-b0ea-aeb2bb358f67 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1094 microversion: 2.1 time: 0.068930 Jul 14 11:54:58.882125 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 563/1078] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:58 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:54:59.899564 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e27ae020-acf7-4902-a837-dda616e12138 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:54:59.900259 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e27ae020-acf7-4902-a837-dda616e12138 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:54:59.908237 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e27ae020-acf7-4902-a837-dda616e12138 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:59.908682 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e27ae020-acf7-4902-a837-dda616e12138 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:59.909484 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e27ae020-acf7-4902-a837-dda616e12138 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:54:59.909923 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e27ae020-acf7-4902-a837-dda616e12138 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:54:59.975947 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e27ae020-acf7-4902-a837-dda616e12138 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:54:59.983607 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e27ae020-acf7-4902-a837-dda616e12138 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1136 microversion: 2.1 time: 0.089013 Jul 14 11:54:59.984327 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 516/1079] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:54:59 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1136 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:01.001144 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-da77489a-7c7f-4dd6-bd37-d4eae5ba857d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:01.002943 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-da77489a-7c7f-4dd6-bd37-d4eae5ba857d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:01.011063 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-da77489a-7c7f-4dd6-bd37-d4eae5ba857d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:01.011519 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-da77489a-7c7f-4dd6-bd37-d4eae5ba857d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:01.012578 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-da77489a-7c7f-4dd6-bd37-d4eae5ba857d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:01.012941 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-da77489a-7c7f-4dd6-bd37-d4eae5ba857d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:01.085274 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-da77489a-7c7f-4dd6-bd37-d4eae5ba857d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:01.092986 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-da77489a-7c7f-4dd6-bd37-d4eae5ba857d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1210 microversion: 2.1 time: 0.095784 Jul 14 11:55:01.093599 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 564/1080] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:00 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:02.110872 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a25c7bce-b0c9-4457-b954-203b3b15b88d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:02.111480 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a25c7bce-b0c9-4457-b954-203b3b15b88d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:02.119432 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a25c7bce-b0c9-4457-b954-203b3b15b88d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:02.119879 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a25c7bce-b0c9-4457-b954-203b3b15b88d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:02.120652 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a25c7bce-b0c9-4457-b954-203b3b15b88d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:02.121094 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a25c7bce-b0c9-4457-b954-203b3b15b88d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:02.325569 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a25c7bce-b0c9-4457-b954-203b3b15b88d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:02.333457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a25c7bce-b0c9-4457-b954-203b3b15b88d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1277 microversion: 2.1 time: 0.226460 Jul 14 11:55:02.334157 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 517/1081] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:02 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:02.841442 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-28e4e873-b514-45da-9f3f-1d78bea7c111 req-2cd1b4d3-7313-49af-98ce-6a1d07c7ffb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aff10b1-193b-4ee2-93a1-d16ca2258d03", "tag": "508effd0-c068-4bd7-a603-c11584bfe334"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:55:02.855971 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-28e4e873-b514-45da-9f3f-1d78bea7c111 req-2cd1b4d3-7313-49af-98ce-6a1d07c7ffb5 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:02.860025 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-28e4e873-b514-45da-9f3f-1d78bea7c111 req-2cd1b4d3-7313-49af-98ce-6a1d07c7ffb5 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:02.871806 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-28e4e873-b514-45da-9f3f-1d78bea7c111 req-2cd1b4d3-7313-49af-98ce-6a1d07c7ffb5 service nova] Creating event network-changed:508effd0-c068-4bd7-a603-c11584bfe334 for instance 6aff10b1-193b-4ee2-93a1-d16ca2258d03 on hv-cinder-84980 Jul 14 11:55:02.877113 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-28e4e873-b514-45da-9f3f-1d78bea7c111 req-2cd1b4d3-7313-49af-98ce-6a1d07c7ffb5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125879 Jul 14 11:55:02.883446 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 565/1082] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:55:03.350416 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-800978b0-873a-4e09-953f-54a127c1b0af tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:03.351058 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-800978b0-873a-4e09-953f-54a127c1b0af tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:03.358231 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-800978b0-873a-4e09-953f-54a127c1b0af tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:03.358684 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-800978b0-873a-4e09-953f-54a127c1b0af tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:03.359457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-800978b0-873a-4e09-953f-54a127c1b0af tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:03.359891 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-800978b0-873a-4e09-953f-54a127c1b0af tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:03.517725 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-800978b0-873a-4e09-953f-54a127c1b0af tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:03.525833 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-800978b0-873a-4e09-953f-54a127c1b0af tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1265 microversion: 2.1 time: 0.179914 Jul 14 11:55:03.526407 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 518/1083] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:03 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:04.546251 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b282876b-2dd2-49ff-8f15-b4db805b82bc tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:04.546959 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b282876b-2dd2-49ff-8f15-b4db805b82bc tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:04.553826 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b282876b-2dd2-49ff-8f15-b4db805b82bc tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:04.554279 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b282876b-2dd2-49ff-8f15-b4db805b82bc tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:04.555058 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b282876b-2dd2-49ff-8f15-b4db805b82bc tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:04.555497 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b282876b-2dd2-49ff-8f15-b4db805b82bc tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:04.689575 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b282876b-2dd2-49ff-8f15-b4db805b82bc tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:04.697071 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b282876b-2dd2-49ff-8f15-b4db805b82bc tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1265 microversion: 2.1 time: 0.155674 Jul 14 11:55:04.697658 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 566/1084] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:04 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:05.714321 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ad9a15b0-7b13-42d0-95e7-f7a5ea51827c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:05.714873 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ad9a15b0-7b13-42d0-95e7-f7a5ea51827c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:05.721468 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ad9a15b0-7b13-42d0-95e7-f7a5ea51827c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:05.722687 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ad9a15b0-7b13-42d0-95e7-f7a5ea51827c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:05.722796 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ad9a15b0-7b13-42d0-95e7-f7a5ea51827c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:05.723228 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ad9a15b0-7b13-42d0-95e7-f7a5ea51827c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:05.854941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ad9a15b0-7b13-42d0-95e7-f7a5ea51827c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:05.862461 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ad9a15b0-7b13-42d0-95e7-f7a5ea51827c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1265 microversion: 2.1 time: 0.152068 Jul 14 11:55:05.863037 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 519/1085] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:05 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:55:06.879214 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f5f201c8-5c41-4dc0-99b8-b829ad209632 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:06.879810 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f5f201c8-5c41-4dc0-99b8-b829ad209632 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:06.886777 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f5f201c8-5c41-4dc0-99b8-b829ad209632 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:06.887227 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f5f201c8-5c41-4dc0-99b8-b829ad209632 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:06.887993 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f5f201c8-5c41-4dc0-99b8-b829ad209632 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:06.888462 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f5f201c8-5c41-4dc0-99b8-b829ad209632 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:07.025115 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-f5f201c8-5c41-4dc0-99b8-b829ad209632 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:07.025650 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-dca624cf-27b5-4ae8-8c9b-adad68348b6a tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11cbae30-b8de-4232-9d60-bfa449eed2e5", "device": "/dev/sdb"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:55:07.027299 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-dca624cf-27b5-4ae8-8c9b-adad68348b6a tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:07.032965 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f5f201c8-5c41-4dc0-99b8-b829ad209632 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1265 microversion: 2.1 time: 0.157652 Jul 14 11:55:07.033562 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 567/1086] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:06 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:07.034649 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dca624cf-27b5-4ae8-8c9b-adad68348b6a tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:07.035106 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dca624cf-27b5-4ae8-8c9b-adad68348b6a tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:07.035887 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dca624cf-27b5-4ae8-8c9b-adad68348b6a tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:07.036328 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-dca624cf-27b5-4ae8-8c9b-adad68348b6a tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:07.797318 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-dca624cf-27b5-4ae8-8c9b-adad68348b6a tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "POST /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.776111 Jul 14 11:55:07.797939 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 520/1087] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 11:55:07 2022] POST /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397/os-volume_attachments => generated 194 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:55:08.050461 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-502530a5-417a-4db5-8f02-703adc0e782b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:08.051093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-502530a5-417a-4db5-8f02-703adc0e782b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:08.058546 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-502530a5-417a-4db5-8f02-703adc0e782b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:08.058985 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-502530a5-417a-4db5-8f02-703adc0e782b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:08.059771 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-502530a5-417a-4db5-8f02-703adc0e782b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:08.060200 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-502530a5-417a-4db5-8f02-703adc0e782b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:08.197484 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-502530a5-417a-4db5-8f02-703adc0e782b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:08.205136 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-502530a5-417a-4db5-8f02-703adc0e782b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1265 microversion: 2.1 time: 0.158884 Jul 14 11:55:08.205726 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 568/1088] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:08 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:09.220570 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:09.221315 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=6 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:09.225917 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b10b7e86-7d2b-4956-b8c2-67ebbf6f05e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:09.226616 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b10b7e86-7d2b-4956-b8c2-67ebbf6f05e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:09.234142 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b10b7e86-7d2b-4956-b8c2-67ebbf6f05e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:09.234591 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b10b7e86-7d2b-4956-b8c2-67ebbf6f05e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:09.235365 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b10b7e86-7d2b-4956-b8c2-67ebbf6f05e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:09.235798 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b10b7e86-7d2b-4956-b8c2-67ebbf6f05e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:09.375425 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b10b7e86-7d2b-4956-b8c2-67ebbf6f05e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:09.383049 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b10b7e86-7d2b-4956-b8c2-67ebbf6f05e1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1265 microversion: 2.1 time: 0.163963 Jul 14 11:55:09.383660 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 521/1089] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:09 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:10.400123 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-77f70fd0-5af7-4434-ba55-f67a6bd39ef5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:10.400737 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-77f70fd0-5af7-4434-ba55-f67a6bd39ef5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:10.402758 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:10.403871 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:10.408621 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-77f70fd0-5af7-4434-ba55-f67a6bd39ef5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:10.409074 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-77f70fd0-5af7-4434-ba55-f67a6bd39ef5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:10.409889 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-77f70fd0-5af7-4434-ba55-f67a6bd39ef5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:10.410330 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-77f70fd0-5af7-4434-ba55-f67a6bd39ef5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:10.413591 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:10.541536 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-77f70fd0-5af7-4434-ba55-f67a6bd39ef5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:10.548946 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-77f70fd0-5af7-4434-ba55-f67a6bd39ef5 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1265 microversion: 2.1 time: 0.153303 Jul 14 11:55:10.549540 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 569/1090] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:10 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:11.566705 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-df4b6269-430c-4378-9d54-64c5e1d858fb tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:11.567340 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-df4b6269-430c-4378-9d54-64c5e1d858fb tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:11.570380 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:11.575201 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-df4b6269-430c-4378-9d54-64c5e1d858fb tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:11.575656 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-df4b6269-430c-4378-9d54-64c5e1d858fb tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:11.576438 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-df4b6269-430c-4378-9d54-64c5e1d858fb tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:11.577020 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-df4b6269-430c-4378-9d54-64c5e1d858fb tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:11.581072 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:11.708641 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-df4b6269-430c-4378-9d54-64c5e1d858fb tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:11.715809 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-df4b6269-430c-4378-9d54-64c5e1d858fb tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1265 microversion: 2.1 time: 0.154320 Jul 14 11:55:11.716375 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 522/1091] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:11 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:12.732714 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-49ab05d7-a3f7-4ea2-8cf1-86a8aff07a18 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:12.733289 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-49ab05d7-a3f7-4ea2-8cf1-86a8aff07a18 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:12.740497 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-49ab05d7-a3f7-4ea2-8cf1-86a8aff07a18 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:12.740938 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-49ab05d7-a3f7-4ea2-8cf1-86a8aff07a18 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:12.741731 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-49ab05d7-a3f7-4ea2-8cf1-86a8aff07a18 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:12.742158 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-49ab05d7-a3f7-4ea2-8cf1-86a8aff07a18 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:12.883151 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-49ab05d7-a3f7-4ea2-8cf1-86a8aff07a18 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:12.890596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-49ab05d7-a3f7-4ea2-8cf1-86a8aff07a18 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1265 microversion: 2.1 time: 0.162223 Jul 14 11:55:12.891412 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 570/1092] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:12 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:13.520008 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-f3bb979a-593d-4e46-84c3-d65a87403c76 req-6ee90a24-1a1a-4531-9ff1-74b41335d366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aff10b1-193b-4ee2-93a1-d16ca2258d03", "name": "network-vif-plugged", "status": "completed", "tag": "508effd0-c068-4bd7-a603-c11584bfe334"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:55:13.529481 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-f3bb979a-593d-4e46-84c3-d65a87403c76 req-6ee90a24-1a1a-4531-9ff1-74b41335d366 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:13.529929 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-f3bb979a-593d-4e46-84c3-d65a87403c76 req-6ee90a24-1a1a-4531-9ff1-74b41335d366 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:13.541384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-f3bb979a-593d-4e46-84c3-d65a87403c76 req-6ee90a24-1a1a-4531-9ff1-74b41335d366 service nova] Creating event network-vif-plugged:508effd0-c068-4bd7-a603-c11584bfe334 for instance 6aff10b1-193b-4ee2-93a1-d16ca2258d03 on hv-cinder-84980 Jul 14 11:55:13.546461 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-f3bb979a-593d-4e46-84c3-d65a87403c76 req-6ee90a24-1a1a-4531-9ff1-74b41335d366 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031654 Jul 14 11:55:13.547121 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 523/1093] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:55:13.907937 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-85631a47-59ab-4293-86c5-9e6a4ab26053 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:13.908477 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-85631a47-59ab-4293-86c5-9e6a4ab26053 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:13.915529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85631a47-59ab-4293-86c5-9e6a4ab26053 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:13.915963 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85631a47-59ab-4293-86c5-9e6a4ab26053 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:13.916718 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85631a47-59ab-4293-86c5-9e6a4ab26053 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:13.917148 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-85631a47-59ab-4293-86c5-9e6a4ab26053 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:14.060589 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-85631a47-59ab-4293-86c5-9e6a4ab26053 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:14.068288 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-85631a47-59ab-4293-86c5-9e6a4ab26053 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1265 microversion: 2.1 time: 0.164315 Jul 14 11:55:14.068871 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 571/1094] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:13 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:15.088970 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a1d5de66-6985-46bf-b237-426441800d54 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:15.089686 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a1d5de66-6985-46bf-b237-426441800d54 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:15.096328 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a1d5de66-6985-46bf-b237-426441800d54 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:15.096769 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a1d5de66-6985-46bf-b237-426441800d54 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:15.097554 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a1d5de66-6985-46bf-b237-426441800d54 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:15.097993 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a1d5de66-6985-46bf-b237-426441800d54 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:15.241605 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a1d5de66-6985-46bf-b237-426441800d54 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:15.250080 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a1d5de66-6985-46bf-b237-426441800d54 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1265 microversion: 2.1 time: 0.165824 Jul 14 11:55:15.250656 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 524/1095] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:15 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:16.274372 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-0afd3cc5-c362-44c8-8d6c-76e81d4982f1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:16.274971 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-0afd3cc5-c362-44c8-8d6c-76e81d4982f1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:16.281495 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0afd3cc5-c362-44c8-8d6c-76e81d4982f1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:16.281939 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0afd3cc5-c362-44c8-8d6c-76e81d4982f1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:16.282694 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0afd3cc5-c362-44c8-8d6c-76e81d4982f1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:16.283153 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0afd3cc5-c362-44c8-8d6c-76e81d4982f1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:16.419866 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-0afd3cc5-c362-44c8-8d6c-76e81d4982f1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:16.427352 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-0afd3cc5-c362-44c8-8d6c-76e81d4982f1 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1453 microversion: 2.1 time: 0.156824 Jul 14 11:55:16.428666 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 572/1096] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:16 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:16.444469 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-224a1c3e-f67a-431c-9fda-508937140b09 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:16.445087 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-224a1c3e-f67a-431c-9fda-508937140b09 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:16.451556 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-224a1c3e-f67a-431c-9fda-508937140b09 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:16.452015 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-224a1c3e-f67a-431c-9fda-508937140b09 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:16.452786 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-224a1c3e-f67a-431c-9fda-508937140b09 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:16.453267 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-224a1c3e-f67a-431c-9fda-508937140b09 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:16.583208 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-224a1c3e-f67a-431c-9fda-508937140b09 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:16.591511 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-224a1c3e-f67a-431c-9fda-508937140b09 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1453 microversion: 2.1 time: 0.151627 Jul 14 11:55:16.592080 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 525/1097] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:16 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:18.520263 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-7f949be0-bb70-4839-b3d8-bf01194d32e2 req-2bc22517-2650-4030-8f29-d552a9f0e159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aff10b1-193b-4ee2-93a1-d16ca2258d03", "tag": "508effd0-c068-4bd7-a603-c11584bfe334"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:55:18.529445 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-7f949be0-bb70-4839-b3d8-bf01194d32e2 req-2bc22517-2650-4030-8f29-d552a9f0e159 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:18.529891 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-7f949be0-bb70-4839-b3d8-bf01194d32e2 req-2bc22517-2650-4030-8f29-d552a9f0e159 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:18.541280 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-7f949be0-bb70-4839-b3d8-bf01194d32e2 req-2bc22517-2650-4030-8f29-d552a9f0e159 service nova] Creating event network-changed:508effd0-c068-4bd7-a603-c11584bfe334 for instance 6aff10b1-193b-4ee2-93a1-d16ca2258d03 on hv-cinder-84980 Jul 14 11:55:18.547191 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-7f949be0-bb70-4839-b3d8-bf01194d32e2 req-2bc22517-2650-4030-8f29-d552a9f0e159 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030521 Jul 14 11:55:18.547777 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 573/1098] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:55:32.419975 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-9954ebb7-ea66-4bcd-9a82-4c8075c15da3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:32.420535 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-9954ebb7-ea66-4bcd-9a82-4c8075c15da3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:32.423115 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=7 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:32.423773 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=19 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:32.428526 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9954ebb7-ea66-4bcd-9a82-4c8075c15da3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:32.429814 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9954ebb7-ea66-4bcd-9a82-4c8075c15da3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:32.429814 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9954ebb7-ea66-4bcd-9a82-4c8075c15da3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:32.430206 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-9954ebb7-ea66-4bcd-9a82-4c8075c15da3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:32.510958 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.objects.instance [None req-9954ebb7-ea66-4bcd-9a82-4c8075c15da3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lazy-loading 'services' on Instance uuid 7f1e8e0d-5efe-4abd-8940-06d3c154b397 {{(pid=124946) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:55:32.719648 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-9954ebb7-ea66-4bcd-9a82-4c8075c15da3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397/os-volume_attachments/11cbae30-b8de-4232-9d60-bfa449eed2e5" status: 202 len: 0 microversion: 2.1 time: 0.303380 Jul 14 11:55:32.720147 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 526/1099] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 11:55:32 2022] DELETE /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397/os-volume_attachments/11cbae30-b8de-4232-9d60-bfa449eed2e5 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:55:33.831952 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-d3036566-448d-4709-873e-5e9ce239ad17 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:33.833186 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d3036566-448d-4709-873e-5e9ce239ad17 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:33.834818 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=9 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:33.835453 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=25 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:33.841098 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d3036566-448d-4709-873e-5e9ce239ad17 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:33.841563 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d3036566-448d-4709-873e-5e9ce239ad17 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:33.842324 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d3036566-448d-4709-873e-5e9ce239ad17 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:33.842759 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-d3036566-448d-4709-873e-5e9ce239ad17 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:33.868334 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-d3036566-448d-4709-873e-5e9ce239ad17 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Going to try to terminate instance {{(pid=124947) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:55:34.262892 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-d3036566-448d-4709-873e-5e9ce239ad17 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 204 len: 0 microversion: 2.1 time: 0.434966 Jul 14 11:55:34.263482 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 574/1100] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:55:33 2022] DELETE /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:55:34.273043 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-5104b83d-7977-42fe-b1e0-f0b57f7dc328 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:34.273786 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-5104b83d-7977-42fe-b1e0-f0b57f7dc328 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:34.280177 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5104b83d-7977-42fe-b1e0-f0b57f7dc328 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:34.280626 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5104b83d-7977-42fe-b1e0-f0b57f7dc328 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:34.281415 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5104b83d-7977-42fe-b1e0-f0b57f7dc328 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:34.281852 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-5104b83d-7977-42fe-b1e0-f0b57f7dc328 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:34.421832 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-5104b83d-7977-42fe-b1e0-f0b57f7dc328 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:34.429190 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-5104b83d-7977-42fe-b1e0-f0b57f7dc328 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 200 len: 1514 microversion: 2.1 time: 0.160938 Jul 14 11:55:34.429764 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 527/1101] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:34 2022] GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:35.448147 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1fee5578-d578-440f-977a-6449d524d949 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:35.448819 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1fee5578-d578-440f-977a-6449d524d949 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:35.455297 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1fee5578-d578-440f-977a-6449d524d949 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:35.455745 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1fee5578-d578-440f-977a-6449d524d949 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:35.456516 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1fee5578-d578-440f-977a-6449d524d949 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:35.456953 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1fee5578-d578-440f-977a-6449d524d949 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:35.592035 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1fee5578-d578-440f-977a-6449d524d949 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:35.599728 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1fee5578-d578-440f-977a-6449d524d949 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 200 len: 1514 microversion: 2.1 time: 0.156677 Jul 14 11:55:35.600301 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 575/1102] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:35 2022] GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:36.617030 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-4ee6b1e7-5fba-4c68-a4a4-73e0ce5e293c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:36.617672 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-4ee6b1e7-5fba-4c68-a4a4-73e0ce5e293c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:36.624547 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4ee6b1e7-5fba-4c68-a4a4-73e0ce5e293c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:36.624999 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4ee6b1e7-5fba-4c68-a4a4-73e0ce5e293c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:36.625940 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4ee6b1e7-5fba-4c68-a4a4-73e0ce5e293c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:36.626384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-4ee6b1e7-5fba-4c68-a4a4-73e0ce5e293c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:36.648571 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-bc257782-0b6f-43f9-a354-d71c01a590e1 req-c25f6db4-027b-4aee-b37b-5589f6787f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1e8e0d-5efe-4abd-8940-06d3c154b397", "name": "network-vif-deleted", "tag": "9394448b-942f-4bd9-aa79-84b4f556a19a"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:55:36.657811 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-bc257782-0b6f-43f9-a354-d71c01a590e1 req-c25f6db4-027b-4aee-b37b-5589f6787f98 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:36.658255 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-bc257782-0b6f-43f9-a354-d71c01a590e1 req-c25f6db4-027b-4aee-b37b-5589f6787f98 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:36.669611 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-bc257782-0b6f-43f9-a354-d71c01a590e1 req-c25f6db4-027b-4aee-b37b-5589f6787f98 service nova] Creating event network-vif-deleted:9394448b-942f-4bd9-aa79-84b4f556a19a for instance 7f1e8e0d-5efe-4abd-8940-06d3c154b397 on hv-cinder-84980 Jul 14 11:55:36.676047 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-bc257782-0b6f-43f9-a354-d71c01a590e1 req-c25f6db4-027b-4aee-b37b-5589f6787f98 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031300 Jul 14 11:55:36.676655 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 576/1103] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:55:36.697941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-4ee6b1e7-5fba-4c68-a4a4-73e0ce5e293c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:36.707762 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-4ee6b1e7-5fba-4c68-a4a4-73e0ce5e293c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 200 len: 1472 microversion: 2.1 time: 0.094597 Jul 14 11:55:36.709108 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 528/1104] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:36 2022] GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 1472 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:37.726943 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f269a5c3-ca4c-4901-a0dd-6dd637df908f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:37.727545 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-f269a5c3-ca4c-4901-a0dd-6dd637df908f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: 7f1e8e0d-5efe-4abd-8940-06d3c154b397] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:37.734348 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f269a5c3-ca4c-4901-a0dd-6dd637df908f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:37.734788 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f269a5c3-ca4c-4901-a0dd-6dd637df908f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:37.735573 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f269a5c3-ca4c-4901-a0dd-6dd637df908f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:37.736006 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-f269a5c3-ca4c-4901-a0dd-6dd637df908f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:37.748828 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-f269a5c3-ca4c-4901-a0dd-6dd637df908f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] HTTP exception thrown: Instance 7f1e8e0d-5efe-4abd-8940-06d3c154b397 could not be found. Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f269a5c3-ca4c-4901-a0dd-6dd637df908f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Request method failure captured: Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 HTTP/1.1 Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AP9kc9K4p5Mf4bT0POWKQwmG19LeSPzXft1WOrm-Fjza_Km9AOxA07z9gpe9NnpD1pnAbXCysMnEmv-ORUp7YxuKZRdJbv-NLxdOctpGupq_P9tCNk__tgZhEMPyhCR3G0OSx-7FA5wxbZZZcL7jetCNFyo7ulYtfZdhuZCP-5BXeE Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 81884daddee04f478f047f2c309ad433 Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1706200614 Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:55:37.750454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:55:37.752242 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81884daddee04f478f047f2c309ad433"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81884daddee04f478f047f2c309ad433"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81884daddee04f478f047f2c309ad433"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81884daddee04f478f047f2c309ad433"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:55:37.752242 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-VolumesSnapshotTestJSON-1706200614 Jul 14 11:55:37.752242 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 81884daddee04f478f047f2c309ad433 Jul 14 11:55:37.752242 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1706200614 Jul 14 11:55:37.752242 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-VolumesSnapshotTestJSON-1706200614-project Jul 14 11:55:37.752242 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:55:37.752242 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:55:37.752242 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: d282558617e24bcdb1bf6bddbab7cddd Jul 14 11:55:37.752242 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-VolumesSnapshotTestJSON-1706200614-project Jul 14 11:55:37.752242 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:55:37.752242 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance 7f1e8e0d-5efe-4abd-8940-06d3c154b397 could not be found. Jul 14 11:55:37.752242 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': '7f1e8e0d-5efe-4abd-8940-06d3c154b397'} Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f1e8e0d-5efe-4abd-8940-06d3c154b397 could not be found. Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:55:37.753192 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f1e8e0d-5efe-4abd-8940-06d3c154b397 could not be found. Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f1e8e0d-5efe-4abd-8940-06d3c154b397 could not be found. Jul 14 11:55:37.754852 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:55:37.756416 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-f269a5c3-ca4c-4901-a0dd-6dd637df908f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Returning 404 to user: Instance 7f1e8e0d-5efe-4abd-8940-06d3c154b397 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:55:37.756416 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-f269a5c3-ca4c-4901-a0dd-6dd637df908f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397" status: 404 len: 111 microversion: 2.1 time: 0.029601 Jul 14 11:55:37.756416 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 577/1105] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:37 2022] GET /compute/v2.1/servers/7f1e8e0d-5efe-4abd-8940-06d3c154b397 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:55:47.083563 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-318822600", "imageRef": "bb6054b5-3200-409a-a514-2870ff1abcbc", "flavorRef": "452", "networks": [{"uuid": "d934d39c-6d41-4a49-a5c1-23132bb43486"}]}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:55:47.090954 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=6 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:47.091618 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:47.137989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.network.neutron [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] validate_networks() for [('d934d39c-6d41-4a49-a5c1-23132bb43486', None, None, None, None, None)] {{(pid=124946) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:55:47.490887 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Flavor limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:55:47.491313 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Image limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:55:47.491786 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Flavor pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:55:47.492194 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Image pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:55:47.492606 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:55:47.502114 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:47.502562 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:47.503359 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:47.503799 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:47.521575 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Getting quotas for project 81884daddee04f478f047f2c309ad433. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:55:47.525663 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Getting quotas for user d282558617e24bcdb1bf6bddbab7cddd and project 81884daddee04f478f047f2c309ad433. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:55:47.536502 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Going to run 1 instances... {{(pid=124946) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:55:47.538774 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb6054b5-3200-409a-a514-2870ff1abcbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124946) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:55:47.675162 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-24e21d45-7603-47af-9ef9-1d47534dd4b3 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595447 Jul 14 11:55:47.675737 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 529/1106] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:55:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:55:47.686092 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8d899936-a6ef-4df1-b27e-421be0b6d2c0 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:47.686790 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-8d899936-a6ef-4df1-b27e-421be0b6d2c0 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:47.742193 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-8d899936-a6ef-4df1-b27e-421be0b6d2c0 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:47.744534 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:47.750053 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-8d899936-a6ef-4df1-b27e-421be0b6d2c0 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 200 len: 1218 microversion: 2.1 time: 0.067953 Jul 14 11:55:47.750619 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 578/1107] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:47 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:48.767592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-920ffc0b-11c9-43f6-8fe7-548620c122fa tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:48.768304 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-920ffc0b-11c9-43f6-8fe7-548620c122fa tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:48.775277 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-920ffc0b-11c9-43f6-8fe7-548620c122fa tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:48.775730 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-920ffc0b-11c9-43f6-8fe7-548620c122fa tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:48.776503 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-920ffc0b-11c9-43f6-8fe7-548620c122fa tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:48.777492 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-920ffc0b-11c9-43f6-8fe7-548620c122fa tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:48.839775 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-920ffc0b-11c9-43f6-8fe7-548620c122fa tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:48.847272 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-920ffc0b-11c9-43f6-8fe7-548620c122fa tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 200 len: 1214 microversion: 2.1 time: 0.084347 Jul 14 11:55:48.847843 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 530/1108] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:48 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:49.864982 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b2a83c67-7315-4346-b7c4-bb726841549c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:49.865730 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b2a83c67-7315-4346-b7c4-bb726841549c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:49.874086 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2a83c67-7315-4346-b7c4-bb726841549c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:49.874529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2a83c67-7315-4346-b7c4-bb726841549c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:49.875297 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2a83c67-7315-4346-b7c4-bb726841549c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:49.875907 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2a83c67-7315-4346-b7c4-bb726841549c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:49.947342 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b2a83c67-7315-4346-b7c4-bb726841549c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:49.955337 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b2a83c67-7315-4346-b7c4-bb726841549c tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 200 len: 1276 microversion: 2.1 time: 0.094344 Jul 14 11:55:49.955917 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 579/1109] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:49 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:50.975380 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-f23d4f29-11cb-4c3a-ae11-879a8ba8f04e tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:50.976048 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-f23d4f29-11cb-4c3a-ae11-879a8ba8f04e tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:50.982776 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f23d4f29-11cb-4c3a-ae11-879a8ba8f04e tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:50.983233 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f23d4f29-11cb-4c3a-ae11-879a8ba8f04e tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:50.984018 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f23d4f29-11cb-4c3a-ae11-879a8ba8f04e tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:50.984463 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-f23d4f29-11cb-4c3a-ae11-879a8ba8f04e tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:51.157660 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-51d7ffb8-0d10-4752-8ec0-d9eb1b9875cd req-6f2f2b8b-811b-4ee3-83a0-9095fc907519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e810ba-10f2-43b1-a7ae-135f47e0b0cc", "tag": "e085bf08-af98-4dda-a873-fd5bfd1669eb"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:55:51.166891 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-51d7ffb8-0d10-4752-8ec0-d9eb1b9875cd req-6f2f2b8b-811b-4ee3-83a0-9095fc907519 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:51.168253 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-51d7ffb8-0d10-4752-8ec0-d9eb1b9875cd req-6f2f2b8b-811b-4ee3-83a0-9095fc907519 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:51.173904 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-f23d4f29-11cb-4c3a-ae11-879a8ba8f04e tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:51.182608 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-f23d4f29-11cb-4c3a-ae11-879a8ba8f04e tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 200 len: 1318 microversion: 2.1 time: 0.211908 Jul 14 11:55:51.183054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-51d7ffb8-0d10-4752-8ec0-d9eb1b9875cd req-6f2f2b8b-811b-4ee3-83a0-9095fc907519 service nova] Creating event network-changed:e085bf08-af98-4dda-a873-fd5bfd1669eb for instance d7e810ba-10f2-43b1-a7ae-135f47e0b0cc on hv-cinder-84980 Jul 14 11:55:51.188080 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-51d7ffb8-0d10-4752-8ec0-d9eb1b9875cd req-6f2f2b8b-811b-4ee3-83a0-9095fc907519 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034486 Jul 14 11:55:51.198206 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 580/1110] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:55:51.198988 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 531/1111] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:50 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:51.574889 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:55:51.575157 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Thu Jul 14 11:55:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:55:52.206824 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-9536b685-0c2a-4b92-8ef0-c06e123c0865 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:52.207454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-9536b685-0c2a-4b92-8ef0-c06e123c0865 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:52.213829 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9536b685-0c2a-4b92-8ef0-c06e123c0865 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:52.214783 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9536b685-0c2a-4b92-8ef0-c06e123c0865 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:52.215561 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9536b685-0c2a-4b92-8ef0-c06e123c0865 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:52.216032 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-9536b685-0c2a-4b92-8ef0-c06e123c0865 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:52.349715 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-9536b685-0c2a-4b92-8ef0-c06e123c0865 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:52.357186 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-9536b685-0c2a-4b92-8ef0-c06e123c0865 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 200 len: 1318 microversion: 2.1 time: 0.155146 Jul 14 11:55:52.357742 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 581/1112] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:52 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:53.373998 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-42401a76-924d-42f8-9598-ddab76cd4789 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:53.374558 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-42401a76-924d-42f8-9598-ddab76cd4789 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:53.381223 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-42401a76-924d-42f8-9598-ddab76cd4789 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:53.381682 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-42401a76-924d-42f8-9598-ddab76cd4789 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:53.382459 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-42401a76-924d-42f8-9598-ddab76cd4789 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:53.382899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-42401a76-924d-42f8-9598-ddab76cd4789 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:53.516408 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-42401a76-924d-42f8-9598-ddab76cd4789 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:53.524318 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-42401a76-924d-42f8-9598-ddab76cd4789 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 200 len: 1318 microversion: 2.1 time: 0.154907 Jul 14 11:55:53.524888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 532/1113] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:53 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:54.541032 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1789294e-9b3d-4304-b4d4-8f6a9da498c8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:54.541682 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1789294e-9b3d-4304-b4d4-8f6a9da498c8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:54.548663 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1789294e-9b3d-4304-b4d4-8f6a9da498c8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:54.549113 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1789294e-9b3d-4304-b4d4-8f6a9da498c8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:54.549914 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1789294e-9b3d-4304-b4d4-8f6a9da498c8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:54.550350 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1789294e-9b3d-4304-b4d4-8f6a9da498c8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:54.678042 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1789294e-9b3d-4304-b4d4-8f6a9da498c8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:54.686150 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1789294e-9b3d-4304-b4d4-8f6a9da498c8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 200 len: 1318 microversion: 2.1 time: 0.149050 Jul 14 11:55:54.686740 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 582/1114] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:54 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:55.703278 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-a26c86c2-fb01-46d5-8e8b-f4a20f80afd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:55.703893 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-a26c86c2-fb01-46d5-8e8b-f4a20f80afd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:55.710558 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a26c86c2-fb01-46d5-8e8b-f4a20f80afd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:55.711017 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a26c86c2-fb01-46d5-8e8b-f4a20f80afd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:55.711796 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a26c86c2-fb01-46d5-8e8b-f4a20f80afd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:55.712242 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-a26c86c2-fb01-46d5-8e8b-f4a20f80afd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:55.849388 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-a26c86c2-fb01-46d5-8e8b-f4a20f80afd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:55.856842 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-a26c86c2-fb01-46d5-8e8b-f4a20f80afd2 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 200 len: 1318 microversion: 2.1 time: 0.158197 Jul 14 11:55:55.857440 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 533/1115] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:55 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:56.873637 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-dcf3f3b6-84a9-47e9-8b67-d84ac8fef7a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:56.874246 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-dcf3f3b6-84a9-47e9-8b67-d84ac8fef7a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:56.880700 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dcf3f3b6-84a9-47e9-8b67-d84ac8fef7a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:56.881169 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dcf3f3b6-84a9-47e9-8b67-d84ac8fef7a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:56.881951 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dcf3f3b6-84a9-47e9-8b67-d84ac8fef7a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:56.882391 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-dcf3f3b6-84a9-47e9-8b67-d84ac8fef7a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:57.020174 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-dcf3f3b6-84a9-47e9-8b67-d84ac8fef7a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:57.029577 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-dcf3f3b6-84a9-47e9-8b67-d84ac8fef7a8 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 200 len: 1318 microversion: 2.1 time: 0.159545 Jul 14 11:55:57.043911 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 583/1116] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:56 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:57.716470 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-113a379b-7419-4548-83d7-04fb7547d5eb req-a016d9b3-2007-4bdf-8911-a8e83cacb5ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e810ba-10f2-43b1-a7ae-135f47e0b0cc", "name": "network-vif-plugged", "status": "completed", "tag": "e085bf08-af98-4dda-a873-fd5bfd1669eb"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:55:57.720457 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:57.721314 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=6 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:57.726550 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-113a379b-7419-4548-83d7-04fb7547d5eb req-a016d9b3-2007-4bdf-8911-a8e83cacb5ce service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:57.726988 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-113a379b-7419-4548-83d7-04fb7547d5eb req-a016d9b3-2007-4bdf-8911-a8e83cacb5ce service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:57.740491 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-113a379b-7419-4548-83d7-04fb7547d5eb req-a016d9b3-2007-4bdf-8911-a8e83cacb5ce service nova] Creating event network-vif-plugged:e085bf08-af98-4dda-a873-fd5bfd1669eb for instance d7e810ba-10f2-43b1-a7ae-135f47e0b0cc on hv-cinder-84980 Jul 14 11:55:57.745582 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-113a379b-7419-4548-83d7-04fb7547d5eb req-a016d9b3-2007-4bdf-8911-a8e83cacb5ce service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032689 Jul 14 11:55:57.746097 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 534/1117] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:55:58.047365 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-470be9f2-733d-49cf-ae31-9633689c4623 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:58.048272 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-470be9f2-733d-49cf-ae31-9633689c4623 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:58.050405 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:55:58.056455 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-470be9f2-733d-49cf-ae31-9633689c4623 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:58.065316 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-470be9f2-733d-49cf-ae31-9633689c4623 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:58.065316 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-470be9f2-733d-49cf-ae31-9633689c4623 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:58.065316 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-470be9f2-733d-49cf-ae31-9633689c4623 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:58.189608 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-470be9f2-733d-49cf-ae31-9633689c4623 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:58.197193 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-470be9f2-733d-49cf-ae31-9633689c4623 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 200 len: 1318 microversion: 2.1 time: 0.154912 Jul 14 11:55:58.197760 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 584/1118] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:58 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:55:59.215815 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e612ecfd-97dc-4cc6-a1dd-fa63415dba9f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:55:59.217180 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e612ecfd-97dc-4cc6-a1dd-fa63415dba9f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:55:59.224172 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e612ecfd-97dc-4cc6-a1dd-fa63415dba9f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:59.224625 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e612ecfd-97dc-4cc6-a1dd-fa63415dba9f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:59.225430 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e612ecfd-97dc-4cc6-a1dd-fa63415dba9f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:55:59.225869 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e612ecfd-97dc-4cc6-a1dd-fa63415dba9f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:55:59.358248 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e612ecfd-97dc-4cc6-a1dd-fa63415dba9f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:55:59.371307 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e612ecfd-97dc-4cc6-a1dd-fa63415dba9f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 200 len: 1318 microversion: 2.1 time: 0.160441 Jul 14 11:55:59.372025 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 535/1119] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:55:59 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:56:00.389627 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-3ab24f73-15b8-49cd-9cf1-a45cd70addb4 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:56:00.390487 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-3ab24f73-15b8-49cd-9cf1-a45cd70addb4 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:56:00.397623 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3ab24f73-15b8-49cd-9cf1-a45cd70addb4 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:00.398080 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3ab24f73-15b8-49cd-9cf1-a45cd70addb4 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:00.398860 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3ab24f73-15b8-49cd-9cf1-a45cd70addb4 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:00.399298 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-3ab24f73-15b8-49cd-9cf1-a45cd70addb4 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:00.535989 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-3ab24f73-15b8-49cd-9cf1-a45cd70addb4 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:56:00.543646 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-3ab24f73-15b8-49cd-9cf1-a45cd70addb4 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 200 len: 1508 microversion: 2.1 time: 0.158491 Jul 14 11:56:00.544222 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 585/1120] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:56:00 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:56:00.560035 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d5dc5805-a92f-47b0-b20d-4d43f721cb4f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c72b2f92-6e65-45c6-9dee-b2336970aab4", "device": "/dev/sdb"}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:56:00.561123 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d5dc5805-a92f-47b0-b20d-4d43f721cb4f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:56:00.567765 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5dc5805-a92f-47b0-b20d-4d43f721cb4f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:00.568207 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5dc5805-a92f-47b0-b20d-4d43f721cb4f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:00.568970 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5dc5805-a92f-47b0-b20d-4d43f721cb4f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:00.569427 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d5dc5805-a92f-47b0-b20d-4d43f721cb4f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:01.317545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d5dc5805-a92f-47b0-b20d-4d43f721cb4f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "POST /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761301 Jul 14 11:56:01.318173 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 536/1121] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 11:56:00 2022] POST /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:56:21.298753 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-ddfe2269-7734-4f1b-bd7e-bbc6f7170023 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:56:21.299251 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-ddfe2269-7734-4f1b-bd7e-bbc6f7170023 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:56:21.302677 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:21.303380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=38 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:21.306844 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ddfe2269-7734-4f1b-bd7e-bbc6f7170023 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:21.311267 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ddfe2269-7734-4f1b-bd7e-bbc6f7170023 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:21.311267 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ddfe2269-7734-4f1b-bd7e-bbc6f7170023 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:21.311267 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-ddfe2269-7734-4f1b-bd7e-bbc6f7170023 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:21.391707 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.objects.instance [None req-ddfe2269-7734-4f1b-bd7e-bbc6f7170023 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lazy-loading 'services' on Instance uuid d7e810ba-10f2-43b1-a7ae-135f47e0b0cc {{(pid=124947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:56:21.644085 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-ddfe2269-7734-4f1b-bd7e-bbc6f7170023 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc/os-volume_attachments/c72b2f92-6e65-45c6-9dee-b2336970aab4" status: 202 len: 0 microversion: 2.1 time: 0.348971 Jul 14 11:56:21.644601 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 586/1122] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 11:56:21 2022] DELETE /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc/os-volume_attachments/c72b2f92-6e65-45c6-9dee-b2336970aab4 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:56:22.751772 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:22.752556 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:56:22.756575 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6c6e4dce-f2cd-4298-aa0f-76b76ca7b17a tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:56:22.758851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6c6e4dce-f2cd-4298-aa0f-76b76ca7b17a tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:56:22.763950 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6c6e4dce-f2cd-4298-aa0f-76b76ca7b17a tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:22.764653 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6c6e4dce-f2cd-4298-aa0f-76b76ca7b17a tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:22.765449 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6c6e4dce-f2cd-4298-aa0f-76b76ca7b17a tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:22.765888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6c6e4dce-f2cd-4298-aa0f-76b76ca7b17a tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:22.791349 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6c6e4dce-f2cd-4298-aa0f-76b76ca7b17a tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Going to try to terminate instance {{(pid=124946) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:56:23.055742 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6c6e4dce-f2cd-4298-aa0f-76b76ca7b17a tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 204 len: 0 microversion: 2.1 time: 0.305204 Jul 14 11:56:23.056369 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 537/1123] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:56:22 2022] DELETE /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:56:23.065503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b395a150-5da2-4392-b762-080ba225a21f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:56:23.066202 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b395a150-5da2-4392-b762-080ba225a21f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:56:23.072453 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b395a150-5da2-4392-b762-080ba225a21f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:23.072904 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b395a150-5da2-4392-b762-080ba225a21f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:23.073706 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b395a150-5da2-4392-b762-080ba225a21f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:23.074144 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b395a150-5da2-4392-b762-080ba225a21f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:23.207423 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b395a150-5da2-4392-b762-080ba225a21f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:56:23.215086 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b395a150-5da2-4392-b762-080ba225a21f tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 200 len: 1514 microversion: 2.1 time: 0.154345 Jul 14 11:56:23.215746 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 587/1124] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:56:23 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:56:24.233420 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-10134f98-3861-402f-be73-4f6166e5e8f5 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:56:24.234087 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-10134f98-3861-402f-be73-4f6166e5e8f5 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:56:24.240544 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-10134f98-3861-402f-be73-4f6166e5e8f5 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:24.240989 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-10134f98-3861-402f-be73-4f6166e5e8f5 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:24.241771 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-10134f98-3861-402f-be73-4f6166e5e8f5 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:24.242207 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-10134f98-3861-402f-be73-4f6166e5e8f5 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:24.375160 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-10134f98-3861-402f-be73-4f6166e5e8f5 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:56:24.382952 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-10134f98-3861-402f-be73-4f6166e5e8f5 tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 200 len: 1514 microversion: 2.1 time: 0.153911 Jul 14 11:56:24.383533 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 538/1125] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:56:24 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:56:25.271723 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-bcea2747-75db-4af7-a290-68d5faf606b1 req-c2be8185-04ff-4ef7-b663-c643d2ee1467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e810ba-10f2-43b1-a7ae-135f47e0b0cc", "name": "network-vif-deleted", "tag": "e085bf08-af98-4dda-a873-fd5bfd1669eb"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:56:25.281292 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-bcea2747-75db-4af7-a290-68d5faf606b1 req-c2be8185-04ff-4ef7-b663-c643d2ee1467 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:25.281742 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-bcea2747-75db-4af7-a290-68d5faf606b1 req-c2be8185-04ff-4ef7-b663-c643d2ee1467 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:25.293864 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-bcea2747-75db-4af7-a290-68d5faf606b1 req-c2be8185-04ff-4ef7-b663-c643d2ee1467 service nova] Creating event network-vif-deleted:e085bf08-af98-4dda-a873-fd5bfd1669eb for instance d7e810ba-10f2-43b1-a7ae-135f47e0b0cc on hv-cinder-84980 Jul 14 11:56:25.299454 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-bcea2747-75db-4af7-a290-68d5faf606b1 req-c2be8185-04ff-4ef7-b663-c643d2ee1467 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031622 Jul 14 11:56:25.300418 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 588/1126] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:56:25.400130 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-ab4c8010-4799-471c-b9c0-09c38868c9af tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:56:25.400764 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-ab4c8010-4799-471c-b9c0-09c38868c9af tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:56:25.408173 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ab4c8010-4799-471c-b9c0-09c38868c9af tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:25.408620 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ab4c8010-4799-471c-b9c0-09c38868c9af tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:25.409423 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ab4c8010-4799-471c-b9c0-09c38868c9af tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:25.409867 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-ab4c8010-4799-471c-b9c0-09c38868c9af tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:25.474851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-ab4c8010-4799-471c-b9c0-09c38868c9af tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd282558617e24bcdb1bf6bddbab7cddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81884daddee04f478f047f2c309ad433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:56:25.482968 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-ab4c8010-4799-471c-b9c0-09c38868c9af tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 200 len: 1303 microversion: 2.1 time: 0.086895 Jul 14 11:56:25.485463 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 539/1127] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:56:25 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 1303 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:56:26.499911 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-49ba9a29-8bb5-49d8-87da-673c187ca5ec tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:56:26.500616 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-49ba9a29-8bb5-49d8-87da-673c187ca5ec tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] [instance: d7e810ba-10f2-43b1-a7ae-135f47e0b0cc] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:56:26.507439 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-49ba9a29-8bb5-49d8-87da-673c187ca5ec tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:26.507890 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-49ba9a29-8bb5-49d8-87da-673c187ca5ec tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:26.508660 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-49ba9a29-8bb5-49d8-87da-673c187ca5ec tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:56:26.509102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-49ba9a29-8bb5-49d8-87da-673c187ca5ec tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:56:26.523025 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-49ba9a29-8bb5-49d8-87da-673c187ca5ec tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] HTTP exception thrown: Instance d7e810ba-10f2-43b1-a7ae-135f47e0b0cc could not be found. Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-49ba9a29-8bb5-49d8-87da-673c187ca5ec tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Request method failure captured: Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc HTTP/1.1 Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0AP9kc9K4p5Mf4bT0POWKQwmG19LeSPzXft1WOrm-Fjza_Km9AOxA07z9gpe9NnpD1pnAbXCysMnEmv-ORUp7YxuKZRdJbv-NLxdOctpGupq_P9tCNk__tgZhEMPyhCR3G0OSx-7FA5wxbZZZcL7jetCNFyo7ulYtfZdhuZCP-5BXeE Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 81884daddee04f478f047f2c309ad433 Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1706200614 Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:56:26.524696 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:56:26.526503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81884daddee04f478f047f2c309ad433"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81884daddee04f478f047f2c309ad433"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81884daddee04f478f047f2c309ad433"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81884daddee04f478f047f2c309ad433"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:56:26.526503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-VolumesSnapshotTestJSON-1706200614 Jul 14 11:56:26.526503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 81884daddee04f478f047f2c309ad433 Jul 14 11:56:26.526503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1706200614 Jul 14 11:56:26.526503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-VolumesSnapshotTestJSON-1706200614-project Jul 14 11:56:26.526503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:56:26.526503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:56:26.526503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: d282558617e24bcdb1bf6bddbab7cddd Jul 14 11:56:26.526503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-VolumesSnapshotTestJSON-1706200614-project Jul 14 11:56:26.526503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:56:26.526503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance d7e810ba-10f2-43b1-a7ae-135f47e0b0cc could not be found. Jul 14 11:56:26.526503 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': 'd7e810ba-10f2-43b1-a7ae-135f47e0b0cc'} Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e810ba-10f2-43b1-a7ae-135f47e0b0cc could not be found. Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:56:26.527596 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e810ba-10f2-43b1-a7ae-135f47e0b0cc could not be found. Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e810ba-10f2-43b1-a7ae-135f47e0b0cc could not be found. Jul 14 11:56:26.529966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:56:26.531201 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-49ba9a29-8bb5-49d8-87da-673c187ca5ec tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] Returning 404 to user: Instance d7e810ba-10f2-43b1-a7ae-135f47e0b0cc could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:56:26.531201 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-49ba9a29-8bb5-49d8-87da-673c187ca5ec tempest-VolumesSnapshotTestJSON-1706200614 tempest-VolumesSnapshotTestJSON-1706200614-project] 10.222.0.40 "GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc" status: 404 len: 111 microversion: 2.1 time: 0.030478 Jul 14 11:56:26.531201 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 589/1128] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:56:26 2022] GET /compute/v2.1/servers/d7e810ba-10f2-43b1-a7ae-135f47e0b0cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:57:16.448532 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-306801656", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-634704875", "security_groups": [{"name": "tempest-secgroup-smoke-630221934"}], "block_device_mapping_v2": [{"uuid": "28227c43-d334-457e-a3f7-301233d3bba7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c22b4386-d3cd-4949-9a26-72cae23c6f3e"}]}} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:57:16.456578 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:16.457273 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:16.567302 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.network.neutron [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] validate_networks() for [('c22b4386-d3cd-4949-9a26-72cae23c6f3e', None, None, None, None, None)] {{(pid=124946) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:57:16.933296 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Flavor limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:57:16.933724 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Image limits 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:57:16.934200 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Flavor pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:57:16.934610 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Image pref 0:0:0 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:57:16.935085 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.virt.hardware [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124946) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:57:16.943885 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:16.944331 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:16.945127 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:16.945593 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:16.965595 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Getting quotas for project 7119e46a06b54c2984b21f32d9c156e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:57:16.969443 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.quota [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Getting quotas for user 1a71cad9c9114c5cb0bf8b4fe982e4d5 and project 7119e46a06b54c2984b21f32d9c156e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124946) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:57:17.027349 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Going to run 1 instances... {{(pid=124946) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:57:17.029512 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='28227c43-d334-457e-a3f7-301233d3bba7',volume_size=None,volume_type=None)] {{(pid=124946) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:57:17.491911 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6cadfa91-1ddc-452c-a593-7692e022bab9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.047248 Jul 14 11:57:17.493118 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 540/1129] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 11:57:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:57:17.503445 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5b070a34-456b-4a79-83d6-4410ebfeea65 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:17.504054 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-5b070a34-456b-4a79-83d6-4410ebfeea65 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:17.508366 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=8 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:17.509738 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:17.561769 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-5b070a34-456b-4a79-83d6-4410ebfeea65 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:17.568586 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-5b070a34-456b-4a79-83d6-4410ebfeea65 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1093 microversion: 2.1 time: 0.069255 Jul 14 11:57:17.569170 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 590/1130] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:17 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:57:18.587009 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-cd5b3ee8-4ec7-4abb-99e1-3599fa5f2aaa tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:18.587637 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-cd5b3ee8-4ec7-4abb-99e1-3599fa5f2aaa tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:18.594061 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cd5b3ee8-4ec7-4abb-99e1-3599fa5f2aaa tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:18.594416 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cd5b3ee8-4ec7-4abb-99e1-3599fa5f2aaa tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:18.595186 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cd5b3ee8-4ec7-4abb-99e1-3599fa5f2aaa tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:18.595624 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-cd5b3ee8-4ec7-4abb-99e1-3599fa5f2aaa tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:18.658904 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-cd5b3ee8-4ec7-4abb-99e1-3599fa5f2aaa tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:18.666439 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-cd5b3ee8-4ec7-4abb-99e1-3599fa5f2aaa tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1143 microversion: 2.1 time: 0.084670 Jul 14 11:57:18.667008 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 541/1131] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:18 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:57:19.683813 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-7ff44253-ae04-4a58-88d1-13d62154bf50 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:19.684431 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-7ff44253-ae04-4a58-88d1-13d62154bf50 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:19.694708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7ff44253-ae04-4a58-88d1-13d62154bf50 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:19.694708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7ff44253-ae04-4a58-88d1-13d62154bf50 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:19.694708 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7ff44253-ae04-4a58-88d1-13d62154bf50 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:19.695103 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-7ff44253-ae04-4a58-88d1-13d62154bf50 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:19.758924 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-7ff44253-ae04-4a58-88d1-13d62154bf50 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:19.767182 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-7ff44253-ae04-4a58-88d1-13d62154bf50 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1209 microversion: 2.1 time: 0.088142 Jul 14 11:57:19.767999 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 591/1132] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:19 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:57:20.785460 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-1bda47e6-e82a-4ef1-94d5-dc007cd2d476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:20.786054 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-1bda47e6-e82a-4ef1-94d5-dc007cd2d476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:20.794342 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1bda47e6-e82a-4ef1-94d5-dc007cd2d476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:20.794851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1bda47e6-e82a-4ef1-94d5-dc007cd2d476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:20.795661 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1bda47e6-e82a-4ef1-94d5-dc007cd2d476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:20.796098 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-1bda47e6-e82a-4ef1-94d5-dc007cd2d476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:20.940995 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-1bda47e6-e82a-4ef1-94d5-dc007cd2d476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:20.951179 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-1bda47e6-e82a-4ef1-94d5-dc007cd2d476 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1264 microversion: 2.1 time: 0.169639 Jul 14 11:57:20.952315 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 542/1133] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:20 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:57:21.254267 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-eda13cb8-e586-4042-b4f9-a1c016c42993 req-f13d137a-c5f6-4c7f-aa3b-2995245a433b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e742fe23-c87e-4a9b-9c46-a30f0ae168a7", "tag": "e7a77a04-d6ff-48d2-8578-e8e4b20bc54b"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:57:21.263190 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-eda13cb8-e586-4042-b4f9-a1c016c42993 req-f13d137a-c5f6-4c7f-aa3b-2995245a433b service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:21.263966 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-eda13cb8-e586-4042-b4f9-a1c016c42993 req-f13d137a-c5f6-4c7f-aa3b-2995245a433b service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:21.276987 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-eda13cb8-e586-4042-b4f9-a1c016c42993 req-f13d137a-c5f6-4c7f-aa3b-2995245a433b service nova] Creating event network-changed:e7a77a04-d6ff-48d2-8578-e8e4b20bc54b for instance e742fe23-c87e-4a9b-9c46-a30f0ae168a7 on hv-cinder-84980 Jul 14 11:57:21.282330 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-eda13cb8-e586-4042-b4f9-a1c016c42993 req-f13d137a-c5f6-4c7f-aa3b-2995245a433b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032042 Jul 14 11:57:21.282924 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 592/1134] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:57:21.969213 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-8b4df6e3-677d-4ebe-8276-b1895171b679 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:21.969836 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-8b4df6e3-677d-4ebe-8276-b1895171b679 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:21.977179 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8b4df6e3-677d-4ebe-8276-b1895171b679 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:21.979333 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8b4df6e3-677d-4ebe-8276-b1895171b679 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:21.979333 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8b4df6e3-677d-4ebe-8276-b1895171b679 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:21.979333 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-8b4df6e3-677d-4ebe-8276-b1895171b679 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:22.113563 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-8b4df6e3-677d-4ebe-8276-b1895171b679 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:22.121331 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-8b4df6e3-677d-4ebe-8276-b1895171b679 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1264 microversion: 2.1 time: 0.155932 Jul 14 11:57:22.121916 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 543/1135] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:21 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:57:23.139999 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-6c0d607e-3cad-4de0-bfd0-97e6705753df tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:23.140699 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-6c0d607e-3cad-4de0-bfd0-97e6705753df tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:23.146935 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6c0d607e-3cad-4de0-bfd0-97e6705753df tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:23.147378 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6c0d607e-3cad-4de0-bfd0-97e6705753df tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:23.148798 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6c0d607e-3cad-4de0-bfd0-97e6705753df tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:23.149260 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-6c0d607e-3cad-4de0-bfd0-97e6705753df tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:23.282149 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-6c0d607e-3cad-4de0-bfd0-97e6705753df tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:23.290093 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-6c0d607e-3cad-4de0-bfd0-97e6705753df tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1264 microversion: 2.1 time: 0.155044 Jul 14 11:57:23.290664 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 593/1136] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:23 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:57:24.306951 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6895f6c5-71ee-4549-8c04-0fd7eea07c59 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:24.307565 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6895f6c5-71ee-4549-8c04-0fd7eea07c59 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:24.314366 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6895f6c5-71ee-4549-8c04-0fd7eea07c59 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:24.314811 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6895f6c5-71ee-4549-8c04-0fd7eea07c59 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:24.315606 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6895f6c5-71ee-4549-8c04-0fd7eea07c59 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:24.316038 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6895f6c5-71ee-4549-8c04-0fd7eea07c59 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:24.447301 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-6895f6c5-71ee-4549-8c04-0fd7eea07c59 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:24.454795 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6895f6c5-71ee-4549-8c04-0fd7eea07c59 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1264 microversion: 2.1 time: 0.151843 Jul 14 11:57:24.455371 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 544/1137] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:24 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:57:25.472179 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-96bfca20-c5a4-4dfe-857d-86887b2d0cc6 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:25.472738 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-96bfca20-c5a4-4dfe-857d-86887b2d0cc6 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:25.478856 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-96bfca20-c5a4-4dfe-857d-86887b2d0cc6 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:25.479298 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-96bfca20-c5a4-4dfe-857d-86887b2d0cc6 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:25.480056 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-96bfca20-c5a4-4dfe-857d-86887b2d0cc6 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:25.480484 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-96bfca20-c5a4-4dfe-857d-86887b2d0cc6 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:25.607911 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-96bfca20-c5a4-4dfe-857d-86887b2d0cc6 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:25.615429 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-96bfca20-c5a4-4dfe-857d-86887b2d0cc6 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1264 microversion: 2.1 time: 0.147211 Jul 14 11:57:25.616002 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 594/1138] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:25 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:57:26.633624 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-61c02159-8ca6-44ef-8c6e-35234a1d6883 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:26.634270 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-61c02159-8ca6-44ef-8c6e-35234a1d6883 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:26.641083 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-61c02159-8ca6-44ef-8c6e-35234a1d6883 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:26.641564 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-61c02159-8ca6-44ef-8c6e-35234a1d6883 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:26.642331 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-61c02159-8ca6-44ef-8c6e-35234a1d6883 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:26.642770 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-61c02159-8ca6-44ef-8c6e-35234a1d6883 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:26.772070 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-61c02159-8ca6-44ef-8c6e-35234a1d6883 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:26.780300 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-61c02159-8ca6-44ef-8c6e-35234a1d6883 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1264 microversion: 2.1 time: 0.150634 Jul 14 11:57:26.780874 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 545/1139] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:26 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:57:27.797713 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-5643c611-f10f-4331-9b7c-5e502e5a3fd0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:27.798299 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-5643c611-f10f-4331-9b7c-5e502e5a3fd0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:27.800804 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell0:SELECT=2 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:27.806122 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5643c611-f10f-4331-9b7c-5e502e5a3fd0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:27.806548 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5643c611-f10f-4331-9b7c-5e502e5a3fd0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:27.807313 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5643c611-f10f-4331-9b7c-5e502e5a3fd0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:27.807784 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-5643c611-f10f-4331-9b7c-5e502e5a3fd0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:27.943226 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-5643c611-f10f-4331-9b7c-5e502e5a3fd0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:27.951871 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-5643c611-f10f-4331-9b7c-5e502e5a3fd0 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1264 microversion: 2.1 time: 0.158074 Jul 14 11:57:27.952429 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 595/1140] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:27 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:57:28.968988 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-d0aafcf2-15aa-477a-9461-e2ecebae188c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:28.969579 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-d0aafcf2-15aa-477a-9461-e2ecebae188c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:28.971437 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=2 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:28.972105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell0:SELECT=6 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:57:28.979112 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d0aafcf2-15aa-477a-9461-e2ecebae188c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:28.985289 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d0aafcf2-15aa-477a-9461-e2ecebae188c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:28.985289 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d0aafcf2-15aa-477a-9461-e2ecebae188c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:28.985289 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-d0aafcf2-15aa-477a-9461-e2ecebae188c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:29.119911 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-d0aafcf2-15aa-477a-9461-e2ecebae188c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:29.127447 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-d0aafcf2-15aa-477a-9461-e2ecebae188c tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1264 microversion: 2.1 time: 0.162446 Jul 14 11:57:29.128022 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 546/1141] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:28 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:57:30.144315 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-a2c4ae8d-6062-4762-a004-7d7aa3517f1d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:30.144973 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-a2c4ae8d-6062-4762-a004-7d7aa3517f1d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:30.151951 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a2c4ae8d-6062-4762-a004-7d7aa3517f1d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:30.152405 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a2c4ae8d-6062-4762-a004-7d7aa3517f1d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:30.153184 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a2c4ae8d-6062-4762-a004-7d7aa3517f1d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:30.153627 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-a2c4ae8d-6062-4762-a004-7d7aa3517f1d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:30.289671 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-a2c4ae8d-6062-4762-a004-7d7aa3517f1d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:30.297084 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-a2c4ae8d-6062-4762-a004-7d7aa3517f1d tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1264 microversion: 2.1 time: 0.156722 Jul 14 11:57:30.303546 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 596/1142] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:30 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:57:30.722689 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:57:30.722949 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Thu Jul 14 11:57:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:57:31.314466 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-bba1e25d-15c4-4aa7-9bc7-61094d86c390 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:31.315081 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-bba1e25d-15c4-4aa7-9bc7-61094d86c390 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:31.321726 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bba1e25d-15c4-4aa7-9bc7-61094d86c390 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:31.322182 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bba1e25d-15c4-4aa7-9bc7-61094d86c390 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:31.322960 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bba1e25d-15c4-4aa7-9bc7-61094d86c390 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:31.323397 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-bba1e25d-15c4-4aa7-9bc7-61094d86c390 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:31.454141 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-bba1e25d-15c4-4aa7-9bc7-61094d86c390 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:31.462021 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-bba1e25d-15c4-4aa7-9bc7-61094d86c390 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1264 microversion: 2.1 time: 0.151489 Jul 14 11:57:31.462592 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 547/1143] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:31 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:57:32.140870 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [req-1349e882-98c0-4238-ab7e-b8655555aece req-61e12ce0-cc2b-47a3-907c-77915c8f2a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e742fe23-c87e-4a9b-9c46-a30f0ae168a7", "name": "network-vif-plugged", "status": "completed", "tag": "e7a77a04-d6ff-48d2-8578-e8e4b20bc54b"}]} {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:57:32.150042 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-1349e882-98c0-4238-ab7e-b8655555aece req-61e12ce0-cc2b-47a3-907c-77915c8f2a3f service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:32.150488 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [req-1349e882-98c0-4238-ab7e-b8655555aece req-61e12ce0-cc2b-47a3-907c-77915c8f2a3f service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:32.161330 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.compute.server_external_events [req-1349e882-98c0-4238-ab7e-b8655555aece req-61e12ce0-cc2b-47a3-907c-77915c8f2a3f service nova] Creating event network-vif-plugged:e7a77a04-d6ff-48d2-8578-e8e4b20bc54b for instance e742fe23-c87e-4a9b-9c46-a30f0ae168a7 on hv-cinder-84980 Jul 14 11:57:32.167191 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [req-1349e882-98c0-4238-ab7e-b8655555aece req-61e12ce0-cc2b-47a3-907c-77915c8f2a3f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029535 Jul 14 11:57:32.167191 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 597/1144] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:57:32.479107 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-7b72ab17-afcf-46c6-8d01-3060a8f8a899 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:32.479703 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-7b72ab17-afcf-46c6-8d01-3060a8f8a899 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:32.486558 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7b72ab17-afcf-46c6-8d01-3060a8f8a899 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:32.487105 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7b72ab17-afcf-46c6-8d01-3060a8f8a899 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:32.488003 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7b72ab17-afcf-46c6-8d01-3060a8f8a899 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:32.488441 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-7b72ab17-afcf-46c6-8d01-3060a8f8a899 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:32.643839 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-7b72ab17-afcf-46c6-8d01-3060a8f8a899 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:32.651360 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-7b72ab17-afcf-46c6-8d01-3060a8f8a899 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1264 microversion: 2.1 time: 0.176269 Jul 14 11:57:32.651931 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 548/1145] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:32 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:57:33.670094 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-0605d068-3c3f-4c99-a20f-c7347a258516 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:33.670750 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-0605d068-3c3f-4c99-a20f-c7347a258516 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:33.677022 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0605d068-3c3f-4c99-a20f-c7347a258516 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:33.685132 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0605d068-3c3f-4c99-a20f-c7347a258516 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:33.685132 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0605d068-3c3f-4c99-a20f-c7347a258516 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:33.685132 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0605d068-3c3f-4c99-a20f-c7347a258516 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:33.813995 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-0605d068-3c3f-4c99-a20f-c7347a258516 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:33.822215 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-0605d068-3c3f-4c99-a20f-c7347a258516 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1264 microversion: 2.1 time: 0.156934 Jul 14 11:57:33.822783 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 598/1146] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:33 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:57:34.843505 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-09a0b866-2db4-478a-9b4e-d2fccbcae855 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:34.844133 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-09a0b866-2db4-478a-9b4e-d2fccbcae855 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:34.850889 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-09a0b866-2db4-478a-9b4e-d2fccbcae855 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:34.851930 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-09a0b866-2db4-478a-9b4e-d2fccbcae855 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:34.852713 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-09a0b866-2db4-478a-9b4e-d2fccbcae855 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:34.853186 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-09a0b866-2db4-478a-9b4e-d2fccbcae855 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:34.983199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-09a0b866-2db4-478a-9b4e-d2fccbcae855 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:34.990842 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-09a0b866-2db4-478a-9b4e-d2fccbcae855 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1451 microversion: 2.1 time: 0.155523 Jul 14 11:57:34.991426 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 549/1147] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:34 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:57:35.006734 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b2c836a6-2950-4320-bd02-ec02d64fc595 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:57:35.007492 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b2c836a6-2950-4320-bd02-ec02d64fc595 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:57:35.014436 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2c836a6-2950-4320-bd02-ec02d64fc595 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:35.014879 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2c836a6-2950-4320-bd02-ec02d64fc595 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:35.015668 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2c836a6-2950-4320-bd02-ec02d64fc595 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:35.016100 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b2c836a6-2950-4320-bd02-ec02d64fc595 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:35.149511 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b2c836a6-2950-4320-bd02-ec02d64fc595 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:57:35.157120 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b2c836a6-2950-4320-bd02-ec02d64fc595 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1451 microversion: 2.1 time: 0.154240 Jul 14 11:57:35.161620 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 599/1148] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:57:35 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:57:37.445865 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-94d7d026-d446-476e-9ebe-42bb31e006ac req-b3f28892-53fc-4f42-a37a-4be87ddddcc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e742fe23-c87e-4a9b-9c46-a30f0ae168a7", "tag": "e7a77a04-d6ff-48d2-8578-e8e4b20bc54b"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:57:37.454037 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-94d7d026-d446-476e-9ebe-42bb31e006ac req-b3f28892-53fc-4f42-a37a-4be87ddddcc1 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:57:37.455129 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-94d7d026-d446-476e-9ebe-42bb31e006ac req-b3f28892-53fc-4f42-a37a-4be87ddddcc1 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:57:37.466808 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-94d7d026-d446-476e-9ebe-42bb31e006ac req-b3f28892-53fc-4f42-a37a-4be87ddddcc1 service nova] Creating event network-changed:e7a77a04-d6ff-48d2-8578-e8e4b20bc54b for instance e742fe23-c87e-4a9b-9c46-a30f0ae168a7 on hv-cinder-84980 Jul 14 11:57:37.472113 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-94d7d026-d446-476e-9ebe-42bb31e006ac req-b3f28892-53fc-4f42-a37a-4be87ddddcc1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158005 Jul 14 11:57:37.475723 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 550/1149] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:57:41.840109 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:57:41.840612 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Thu Jul 14 11:57:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:59:09.810201 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_api:SELECT=22 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:09.811006 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG dbcounter [-] [124947] Writing DB stats nova_cell1:SELECT=46 {{(pid=124947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:09.815102 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-8446ef65-5eb8-4a4a-aa50-0baf50c914a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:59:09.815713 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-8446ef65-5eb8-4a4a-aa50-0baf50c914a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:59:09.817819 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:09.818733 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG dbcounter [-] [124946] Writing DB stats nova_cell1:SELECT=58 {{(pid=124946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:59:09.822668 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8446ef65-5eb8-4a4a-aa50-0baf50c914a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:09.830475 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8446ef65-5eb8-4a4a-aa50-0baf50c914a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:09.830475 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8446ef65-5eb8-4a4a-aa50-0baf50c914a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:09.830475 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-8446ef65-5eb8-4a4a-aa50-0baf50c914a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:09.830812 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-54ae6f51-9c3c-4281-80de-c08fcfb39454 req-a22aacac-5ae5-4c0d-8695-aac99d0a840e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e742fe23-c87e-4a9b-9c46-a30f0ae168a7", "tag": "e7a77a04-d6ff-48d2-8578-e8e4b20bc54b"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:59:09.835860 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-54ae6f51-9c3c-4281-80de-c08fcfb39454 req-a22aacac-5ae5-4c0d-8695-aac99d0a840e service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:09.836309 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-54ae6f51-9c3c-4281-80de-c08fcfb39454 req-a22aacac-5ae5-4c0d-8695-aac99d0a840e service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:09.849799 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-54ae6f51-9c3c-4281-80de-c08fcfb39454 req-a22aacac-5ae5-4c0d-8695-aac99d0a840e service nova] Creating event network-changed:e7a77a04-d6ff-48d2-8578-e8e4b20bc54b for instance e742fe23-c87e-4a9b-9c46-a30f0ae168a7 on hv-cinder-84980 Jul 14 11:59:09.852260 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-8446ef65-5eb8-4a4a-aa50-0baf50c914a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Going to try to terminate instance {{(pid=124947) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:59:09.855408 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-54ae6f51-9c3c-4281-80de-c08fcfb39454 req-a22aacac-5ae5-4c0d-8695-aac99d0a840e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040046 Jul 14 11:59:09.856143 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 551/1150] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:59:10.167045 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-8446ef65-5eb8-4a4a-aa50-0baf50c914a9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 204 len: 0 microversion: 2.1 time: 0.358517 Jul 14 11:59:10.167644 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 600/1151] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:59:09 2022] DELETE /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:59:10.176629 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-b6284c71-c7cf-4839-910d-158508af66c8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:59:10.177298 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-b6284c71-c7cf-4839-910d-158508af66c8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:59:10.184272 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b6284c71-c7cf-4839-910d-158508af66c8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:10.184724 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b6284c71-c7cf-4839-910d-158508af66c8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:10.185533 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b6284c71-c7cf-4839-910d-158508af66c8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:10.186597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-b6284c71-c7cf-4839-910d-158508af66c8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:10.326057 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-b6284c71-c7cf-4839-910d-158508af66c8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:59:10.334331 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-b6284c71-c7cf-4839-910d-158508af66c8 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1576 microversion: 2.1 time: 0.162346 Jul 14 11:59:10.334896 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 552/1152] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:59:10 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:59:11.352421 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-aed4f689-2597-4281-b04f-2cbf4c0ede70 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:59:11.353193 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-aed4f689-2597-4281-b04f-2cbf4c0ede70 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:59:11.361373 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aed4f689-2597-4281-b04f-2cbf4c0ede70 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:11.361835 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aed4f689-2597-4281-b04f-2cbf4c0ede70 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:11.362617 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aed4f689-2597-4281-b04f-2cbf4c0ede70 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:11.363055 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-aed4f689-2597-4281-b04f-2cbf4c0ede70 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:11.501591 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-aed4f689-2597-4281-b04f-2cbf4c0ede70 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:59:11.509602 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-aed4f689-2597-4281-b04f-2cbf4c0ede70 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1576 microversion: 2.1 time: 0.161171 Jul 14 11:59:11.510194 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 601/1153] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:59:11 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:59:11.583630 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:59:11.584230 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Thu Jul 14 11:59:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:59:12.250578 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-0c7c7a50-5954-431c-8c96-2aa767a157b1 req-235c3646-04f6-4900-9136-58ba02738f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e742fe23-c87e-4a9b-9c46-a30f0ae168a7", "name": "network-vif-deleted", "tag": "e7a77a04-d6ff-48d2-8578-e8e4b20bc54b"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:59:12.259803 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-0c7c7a50-5954-431c-8c96-2aa767a157b1 req-235c3646-04f6-4900-9136-58ba02738f69 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:12.260245 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-0c7c7a50-5954-431c-8c96-2aa767a157b1 req-235c3646-04f6-4900-9136-58ba02738f69 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:12.271594 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-0c7c7a50-5954-431c-8c96-2aa767a157b1 req-235c3646-04f6-4900-9136-58ba02738f69 service nova] Creating event network-vif-deleted:e7a77a04-d6ff-48d2-8578-e8e4b20bc54b for instance e742fe23-c87e-4a9b-9c46-a30f0ae168a7 on hv-cinder-84980 Jul 14 11:59:12.276448 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-0c7c7a50-5954-431c-8c96-2aa767a157b1 req-235c3646-04f6-4900-9136-58ba02738f69 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029888 Jul 14 11:59:12.277053 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 553/1154] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:59:12.527754 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-1725dd7a-01db-44e4-a57d-ca0b95453046 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:59:12.528488 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-1725dd7a-01db-44e4-a57d-ca0b95453046 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:59:12.535384 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1725dd7a-01db-44e4-a57d-ca0b95453046 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:12.535837 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1725dd7a-01db-44e4-a57d-ca0b95453046 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:12.536616 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1725dd7a-01db-44e4-a57d-ca0b95453046 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:12.537060 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-1725dd7a-01db-44e4-a57d-ca0b95453046 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:12.607582 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-1725dd7a-01db-44e4-a57d-ca0b95453046 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:59:12.615539 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-1725dd7a-01db-44e4-a57d-ca0b95453046 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 200 len: 1224 microversion: 2.1 time: 0.091663 Jul 14 11:59:12.616118 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 602/1155] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:59:12 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:59:13.634655 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-182a4672-78d3-4332-88ae-cf1e856bc59b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:59:13.635368 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-182a4672-78d3-4332-88ae-cf1e856bc59b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: e742fe23-c87e-4a9b-9c46-a30f0ae168a7] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:59:13.641634 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-182a4672-78d3-4332-88ae-cf1e856bc59b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:13.642088 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-182a4672-78d3-4332-88ae-cf1e856bc59b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:13.642856 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-182a4672-78d3-4332-88ae-cf1e856bc59b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:13.643299 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-182a4672-78d3-4332-88ae-cf1e856bc59b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:13.656429 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-182a4672-78d3-4332-88ae-cf1e856bc59b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] HTTP exception thrown: Instance e742fe23-c87e-4a9b-9c46-a30f0ae168a7 could not be found. Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-182a4672-78d3-4332-88ae-cf1e856bc59b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Request method failure captured: Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 HTTP/1.1 Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0ANCSdxumVbFxLq3MTUZvQsCwhVTkzXtYsq36ntRUdlb-1dTHQiUFv49SCoLzZJ5gnQyPDPMjaBT1935c1S8Nv4aAsSWwNHHF674DgwEGdVkEArzdjwfdBhGlgExlG1V9r1HKIgfh_ZTK6XOxEChtBS_rDbSG-A8Fo-azMEt1w2Sd_M Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 7119e46a06b54c2984b21f32d9c156e3 Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-TestVolumeBootPattern-810863928 Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:59:13.658091 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:59:13.659898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:59:13.659898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-TestVolumeBootPattern-810863928 Jul 14 11:59:13.659898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 7119e46a06b54c2984b21f32d9c156e3 Jul 14 11:59:13.659898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-TestVolumeBootPattern-810863928 Jul 14 11:59:13.659898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-TestVolumeBootPattern-810863928-project Jul 14 11:59:13.659898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:59:13.659898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:59:13.659898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 1a71cad9c9114c5cb0bf8b4fe982e4d5 Jul 14 11:59:13.659898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-TestVolumeBootPattern-810863928-project Jul 14 11:59:13.659898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:59:13.659898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance e742fe23-c87e-4a9b-9c46-a30f0ae168a7 could not be found. Jul 14 11:59:13.659898 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': 'e742fe23-c87e-4a9b-9c46-a30f0ae168a7'} Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e742fe23-c87e-4a9b-9c46-a30f0ae168a7 could not be found. Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:59:13.660899 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e742fe23-c87e-4a9b-9c46-a30f0ae168a7 could not be found. Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e742fe23-c87e-4a9b-9c46-a30f0ae168a7 could not be found. Jul 14 11:59:13.662635 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:59:13.664072 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-182a4672-78d3-4332-88ae-cf1e856bc59b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Returning 404 to user: Instance e742fe23-c87e-4a9b-9c46-a30f0ae168a7 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:59:13.664072 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-182a4672-78d3-4332-88ae-cf1e856bc59b tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7" status: 404 len: 111 microversion: 2.1 time: 0.029928 Jul 14 11:59:13.664072 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 554/1156] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:59:13 2022] GET /compute/v2.1/servers/e742fe23-c87e-4a9b-9c46-a30f0ae168a7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:59:16.930906 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-0c17e5d9-d5a0-47f2-b0ae-63e8d45584f2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:59:16.931974 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-0c17e5d9-d5a0-47f2-b0ae-63e8d45584f2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:59:16.933082 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-f32a1847-b7f8-464e-9f24-555ef66e7cd9 req-d3aa6961-64a2-43af-9066-d563d646de55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aff10b1-193b-4ee2-93a1-d16ca2258d03", "tag": "508effd0-c068-4bd7-a603-c11584bfe334"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:59:16.939097 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0c17e5d9-d5a0-47f2-b0ae-63e8d45584f2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:16.939810 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0c17e5d9-d5a0-47f2-b0ae-63e8d45584f2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:16.940592 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0c17e5d9-d5a0-47f2-b0ae-63e8d45584f2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:16.941030 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-0c17e5d9-d5a0-47f2-b0ae-63e8d45584f2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:16.942487 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-f32a1847-b7f8-464e-9f24-555ef66e7cd9 req-d3aa6961-64a2-43af-9066-d563d646de55 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:16.942926 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-f32a1847-b7f8-464e-9f24-555ef66e7cd9 req-d3aa6961-64a2-43af-9066-d563d646de55 service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:16.958572 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-f32a1847-b7f8-464e-9f24-555ef66e7cd9 req-d3aa6961-64a2-43af-9066-d563d646de55 service nova] Creating event network-changed:508effd0-c068-4bd7-a603-c11584bfe334 for instance 6aff10b1-193b-4ee2-93a1-d16ca2258d03 on hv-cinder-84980 Jul 14 11:59:16.963807 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-f32a1847-b7f8-464e-9f24-555ef66e7cd9 req-d3aa6961-64a2-43af-9066-d563d646de55 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034250 Jul 14 11:59:16.964511 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 555/1157] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:59:16.968105 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-0c17e5d9-d5a0-47f2-b0ae-63e8d45584f2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Going to try to terminate instance {{(pid=124947) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:59:17.332902 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-0c17e5d9-d5a0-47f2-b0ae-63e8d45584f2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 204 len: 0 microversion: 2.1 time: 0.405550 Jul 14 11:59:17.333815 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 603/1158] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:59:16 2022] DELETE /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:59:17.343076 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e30b7fe0-9a1d-4cc4-b517-c065af908d7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:59:17.345315 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e30b7fe0-9a1d-4cc4-b517-c065af908d7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:59:17.352969 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e30b7fe0-9a1d-4cc4-b517-c065af908d7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:17.353915 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e30b7fe0-9a1d-4cc4-b517-c065af908d7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:17.355384 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e30b7fe0-9a1d-4cc4-b517-c065af908d7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:17.356260 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e30b7fe0-9a1d-4cc4-b517-c065af908d7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:17.494848 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.policy [None req-e30b7fe0-9a1d-4cc4-b517-c065af908d7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124946) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:59:17.503211 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e30b7fe0-9a1d-4cc4-b517-c065af908d7a tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1578 microversion: 2.1 time: 0.164618 Jul 14 11:59:17.503790 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 556/1159] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:59:17 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:59:18.521495 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-b663a8e3-fe13-468e-9287-28250387a3de tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:59:18.522205 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-b663a8e3-fe13-468e-9287-28250387a3de tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:59:18.528723 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b663a8e3-fe13-468e-9287-28250387a3de tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:18.529207 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b663a8e3-fe13-468e-9287-28250387a3de tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:18.535301 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b663a8e3-fe13-468e-9287-28250387a3de tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:18.535301 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-b663a8e3-fe13-468e-9287-28250387a3de tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:18.667129 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-b663a8e3-fe13-468e-9287-28250387a3de tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:59:18.675346 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-b663a8e3-fe13-468e-9287-28250387a3de tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1459 microversion: 2.1 time: 0.158230 Jul 14 11:59:18.675911 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 604/1160] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:59:18 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1459 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:59:19.312813 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [req-4bf2865d-0e73-4dd5-95ce-8ee6ddbc6e8f req-01107e4e-79ba-4553-a965-374e784851ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aff10b1-193b-4ee2-93a1-d16ca2258d03", "name": "network-vif-deleted", "tag": "508effd0-c068-4bd7-a603-c11584bfe334"}]} {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:59:19.320830 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-4bf2865d-0e73-4dd5-95ce-8ee6ddbc6e8f req-01107e4e-79ba-4553-a965-374e784851ab service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:19.324984 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [req-4bf2865d-0e73-4dd5-95ce-8ee6ddbc6e8f req-01107e4e-79ba-4553-a965-374e784851ab service nova] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:19.332896 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.compute.server_external_events [req-4bf2865d-0e73-4dd5-95ce-8ee6ddbc6e8f req-01107e4e-79ba-4553-a965-374e784851ab service nova] Creating event network-vif-deleted:508effd0-c068-4bd7-a603-c11584bfe334 for instance 6aff10b1-193b-4ee2-93a1-d16ca2258d03 on hv-cinder-84980 Jul 14 11:59:19.337654 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [req-4bf2865d-0e73-4dd5-95ce-8ee6ddbc6e8f req-01107e4e-79ba-4553-a965-374e784851ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029201 Jul 14 11:59:19.338224 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 557/1161] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 11:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:59:19.692779 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-49ad3cc1-645d-45a5-9942-b552f521040e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:59:19.693765 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-49ad3cc1-645d-45a5-9942-b552f521040e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:59:19.701747 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-49ad3cc1-645d-45a5-9942-b552f521040e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:19.702142 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-49ad3cc1-645d-45a5-9942-b552f521040e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:19.702926 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-49ad3cc1-645d-45a5-9942-b552f521040e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:19.703355 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-49ad3cc1-645d-45a5-9942-b552f521040e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:19.768634 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.policy [None req-49ad3cc1-645d-45a5-9942-b552f521040e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a71cad9c9114c5cb0bf8b4fe982e4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7119e46a06b54c2984b21f32d9c156e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124947) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:59:19.776637 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-49ad3cc1-645d-45a5-9942-b552f521040e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 200 len: 1225 microversion: 2.1 time: 0.088019 Jul 14 11:59:19.777235 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 605/1162] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:59:19 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:59:20.800967 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e7d0ad62-b175-4164-ad3f-420aeae519a2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:59:20.801631 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-e7d0ad62-b175-4164-ad3f-420aeae519a2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: 6aff10b1-193b-4ee2-93a1-d16ca2258d03] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:59:20.807959 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e7d0ad62-b175-4164-ad3f-420aeae519a2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:20.808409 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e7d0ad62-b175-4164-ad3f-420aeae519a2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:20.809199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e7d0ad62-b175-4164-ad3f-420aeae519a2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:20.809645 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-e7d0ad62-b175-4164-ad3f-420aeae519a2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:20.823287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-e7d0ad62-b175-4164-ad3f-420aeae519a2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] HTTP exception thrown: Instance 6aff10b1-193b-4ee2-93a1-d16ca2258d03 could not be found. Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e7d0ad62-b175-4164-ad3f-420aeae519a2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Request method failure captured: Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 HTTP/1.1 Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0ANCSdxumVbFxLq3MTUZvQsCwhVTkzXtYsq36ntRUdlb-1dTHQiUFv49SCoLzZJ5gnQyPDPMjaBT1935c1S8Nv4aAsSWwNHHF674DgwEGdVkEArzdjwfdBhGlgExlG1V9r1HKIgfh_ZTK6XOxEChtBS_rDbSG-A8Fo-azMEt1w2Sd_M Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 7119e46a06b54c2984b21f32d9c156e3 Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-TestVolumeBootPattern-810863928 Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:59:20.824941 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:59:20.826851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:59:20.826851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-TestVolumeBootPattern-810863928 Jul 14 11:59:20.826851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 7119e46a06b54c2984b21f32d9c156e3 Jul 14 11:59:20.826851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-TestVolumeBootPattern-810863928 Jul 14 11:59:20.826851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-TestVolumeBootPattern-810863928-project Jul 14 11:59:20.826851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:59:20.826851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:59:20.826851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 1a71cad9c9114c5cb0bf8b4fe982e4d5 Jul 14 11:59:20.826851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-TestVolumeBootPattern-810863928-project Jul 14 11:59:20.826851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:59:20.826851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance 6aff10b1-193b-4ee2-93a1-d16ca2258d03 could not be found. Jul 14 11:59:20.826851 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': '6aff10b1-193b-4ee2-93a1-d16ca2258d03'} Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aff10b1-193b-4ee2-93a1-d16ca2258d03 could not be found. Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:59:20.828545 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aff10b1-193b-4ee2-93a1-d16ca2258d03 could not be found. Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aff10b1-193b-4ee2-93a1-d16ca2258d03 could not be found. Jul 14 11:59:20.830199 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:59:20.831841 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-e7d0ad62-b175-4164-ad3f-420aeae519a2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Returning 404 to user: Instance 6aff10b1-193b-4ee2-93a1-d16ca2258d03 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:59:20.831841 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-e7d0ad62-b175-4164-ad3f-420aeae519a2 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03" status: 404 len: 111 microversion: 2.1 time: 0.030416 Jul 14 11:59:20.831841 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 558/1163] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:59:20 2022] GET /compute/v2.1/servers/6aff10b1-193b-4ee2-93a1-d16ca2258d03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:59:21.562167 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-53e02ed9-832d-43bc-bb40-52c496f504d7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:59:21.566812 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.compute.api [None req-53e02ed9-832d-43bc-bb40-52c496f504d7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124947) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:59:21.569592 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-53e02ed9-832d-43bc-bb40-52c496f504d7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:21.570039 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-53e02ed9-832d-43bc-bb40-52c496f504d7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:21.570810 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-53e02ed9-832d-43bc-bb40-52c496f504d7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:21.571239 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG oslo_concurrency.lockutils [None req-53e02ed9-832d-43bc-bb40-52c496f504d7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:21.584823 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.wsgi [None req-53e02ed9-832d-43bc-bb40-52c496f504d7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] HTTP exception thrown: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-53e02ed9-832d-43bc-bb40-52c496f504d7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Request method failure captured: Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: request: DELETE /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 HTTP/1.1 Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept: application/json Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Accept-Encoding: identity Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Connection: close Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Length: 0 Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Content-Type: application/json Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Host: 10.222.0.40 Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Openstack-System-Scope: None Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: User-Agent: python-urllib3/1.26.9 Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Auth-Token: gAAAAABi0ANCSdxumVbFxLq3MTUZvQsCwhVTkzXtYsq36ntRUdlb-1dTHQiUFv49SCoLzZJ5gnQyPDPMjaBT1935c1S8Nv4aAsSWwNHHF674DgwEGdVkEArzdjwfdBhGlgExlG1V9r1HKIgfh_ZTK6XOxEChtBS_rDbSG-A8Fo-azMEt1w2Sd_M Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Id: None Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Domain-Name: None Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Identity-Status: Confirmed Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Is-Admin-Project: True Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Id: default Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Domain-Name: Default Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Id: 7119e46a06b54c2984b21f32d9c156e3 Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Project-Name: tempest-TestVolumeBootPattern-810863928 Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Role: reader,member Jul 14 11:59:21.586529 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Roles: reader,member Jul 14 11:59:21.588327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:59:21.588327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant: tempest-TestVolumeBootPattern-810863928 Jul 14 11:59:21.588327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Id: 7119e46a06b54c2984b21f32d9c156e3 Jul 14 11:59:21.588327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-Tenant-Name: tempest-TestVolumeBootPattern-810863928 Jul 14 11:59:21.588327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User: tempest-TestVolumeBootPattern-810863928-project Jul 14 11:59:21.588327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Id: default Jul 14 11:59:21.588327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Domain-Name: Default Jul 14 11:59:21.588327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Id: 1a71cad9c9114c5cb0bf8b4fe982e4d5 Jul 14 11:59:21.588327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: X-User-Name: tempest-TestVolumeBootPattern-810863928-project Jul 14 11:59:21.588327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: method: > Jul 14 11:59:21.588327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: exception: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. Jul 14 11:59:21.588327 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: action_args: {'id': 'cec7809b-bc37-4ba9-9481-743c85a10de8'} Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:59:21.589380 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. Jul 14 11:59:21.591021 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: ERROR nova.api.openstack.wsgi Jul 14 11:59:21.593339 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-53e02ed9-832d-43bc-bb40-52c496f504d7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Returning 404 to user: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. {{(pid=124947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:59:21.593339 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-53e02ed9-832d-43bc-bb40-52c496f504d7 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 404 len: 111 microversion: 2.1 time: 0.029805 Jul 14 11:59:21.593339 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 606/1164] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 11:59:21 2022] DELETE /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:59:21.597271 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6563e31a-0929-4973-823d-0693acb064e9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '>' {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:59:21.597888 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.compute.api [None req-6563e31a-0929-4973-823d-0693acb064e9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] [instance: cec7809b-bc37-4ba9-9481-743c85a10de8] Fetching instance by UUID {{(pid=124946) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:59:21.603890 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6563e31a-0929-4973-823d-0693acb064e9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:21.604334 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6563e31a-0929-4973-823d-0693acb064e9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:21.605092 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6563e31a-0929-4973-823d-0693acb064e9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:59:21.605555 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG oslo_concurrency.lockutils [None req-6563e31a-0929-4973-823d-0693acb064e9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Lock "d7a7b1c5-183a-455b-a224-c19c749ad259" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124946) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:59:21.619731 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.wsgi [None req-6563e31a-0929-4973-823d-0693acb064e9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] HTTP exception thrown: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6563e31a-0929-4973-823d-0693acb064e9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Request method failure captured: Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: request: GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 HTTP/1.1 Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept: application/json Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Accept-Encoding: identity Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Connection: close Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Length: 0 Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Content-Type: application/json Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Host: 10.222.0.40 Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Openstack-System-Scope: None Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: User-Agent: python-urllib3/1.26.9 Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Auth-Token: gAAAAABi0ANCSdxumVbFxLq3MTUZvQsCwhVTkzXtYsq36ntRUdlb-1dTHQiUFv49SCoLzZJ5gnQyPDPMjaBT1935c1S8Nv4aAsSWwNHHF674DgwEGdVkEArzdjwfdBhGlgExlG1V9r1HKIgfh_ZTK6XOxEChtBS_rDbSG-A8Fo-azMEt1w2Sd_M Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Id: None Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Domain-Name: None Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Identity-Status: Confirmed Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Is-Admin-Project: True Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Id: default Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Domain-Name: Default Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Id: 7119e46a06b54c2984b21f32d9c156e3 Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Project-Name: tempest-TestVolumeBootPattern-810863928 Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Role: reader,member Jul 14 11:59:21.621287 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Roles: reader,member Jul 14 11:59:21.623246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7119e46a06b54c2984b21f32d9c156e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}] Jul 14 11:59:21.623246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant: tempest-TestVolumeBootPattern-810863928 Jul 14 11:59:21.623246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Id: 7119e46a06b54c2984b21f32d9c156e3 Jul 14 11:59:21.623246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-Tenant-Name: tempest-TestVolumeBootPattern-810863928 Jul 14 11:59:21.623246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User: tempest-TestVolumeBootPattern-810863928-project Jul 14 11:59:21.623246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Id: default Jul 14 11:59:21.623246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Domain-Name: Default Jul 14 11:59:21.623246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Id: 1a71cad9c9114c5cb0bf8b4fe982e4d5 Jul 14 11:59:21.623246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: X-User-Name: tempest-TestVolumeBootPattern-810863928-project Jul 14 11:59:21.623246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: method: > Jul 14 11:59:21.623246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: exception: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. Jul 14 11:59:21.623246 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: action_args: {'id': 'cec7809b-bc37-4ba9-9481-743c85a10de8'} Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: {{(pid=124946) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:59:21.624281 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. Jul 14 11:59:21.626627 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: ERROR nova.api.openstack.wsgi Jul 14 11:59:21.628099 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: DEBUG nova.api.openstack.wsgi [None req-6563e31a-0929-4973-823d-0693acb064e9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Returning 404 to user: Instance cec7809b-bc37-4ba9-9481-743c85a10de8 could not be found. {{(pid=124946) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:59:21.628099 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO nova.api.openstack.requestlog [None req-6563e31a-0929-4973-823d-0693acb064e9 tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8" status: 404 len: 111 microversion: 2.1 time: 0.029958 Jul 14 11:59:21.628099 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: [pid: 124946|app: 0|req: 559/1165] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 11:59:21 2022] GET /compute/v2.1/servers/cec7809b-bc37-4ba9-9481-743c85a10de8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:59:23.168643 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: DEBUG nova.api.openstack.wsgi [None req-334a396d-c8f6-4f78-9973-577318c2da1e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] Calling method '.version_select at 0x7f1aeb1b8dc0>' {{(pid=124947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:59:23.247793 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO nova.api.openstack.requestlog [None req-334a396d-c8f6-4f78-9973-577318c2da1e tempest-TestVolumeBootPattern-810863928 tempest-TestVolumeBootPattern-810863928-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-634704875" status: 202 len: 0 microversion: 2.1 time: 0.086792 Jul 14 11:59:23.248382 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: [pid: 124947|app: 0|req: 607/1166] 10.222.0.40 () {58 vars in 1259 bytes} [Thu Jul 14 11:59:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-634704875 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:01:01.848587 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:01:01.849389 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Thu Jul 14 12:01:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 12:02:30.733017 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:02:30.733783 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Thu Jul 14 12:02:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 12:02:31.592189 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:02:31.592764 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Thu Jul 14 12:02:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 12:02:34.861597 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:02:34.862323 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Thu Jul 14 12:02:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 12:04:21.856942 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:04:21.857483 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Thu Jul 14 12:04:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 12:04:34.705124 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:04:34.710247 dv-cinder-849803-1-iscsi devstack@n-api.service[124946]: Thu Jul 14 12:04:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 12:04:37.707062 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:04:37.707597 dv-cinder-849803-1-iscsi devstack@n-api.service[124947]: Thu Jul 14 12:04:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!